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PREFACE 


During  its  consideration  of  the  utilization  of  automatic 
data  processing  within  the  Department  of  Defense,  the  Blue 
Rihhon  Defense  Panel  was  fortunate  to  receive  an  independent 
analysis  submitted  in  February,  1970,  by  two  consultants  from 
the  private  sector. 

The  substantive  portions  of  their  report  are  considered 
to  be  of  sufficient  importance  to  top-management  personnel  of 
the  Department  of  Defense  to  be  included  as  an  Appendix  with¬ 
out  necessarily  implying  endorsement  by  the  Panel  of  each 
finding  or  recommendat ion. 

The  Panel  is  grateful  to  Mr.  John  P.  Malbrain  and  Mr.  David 
B.  Breedon  for  their  report,  and  to  their  respective  companies, 
North  American  Rockwell,  and  Westinghouse  Electric  Corporation, 
for  donating  the  services  of  these  two  consultants. 
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1.0  EmODUCTION 


During  the  decade  of  the  '50's  the  Department  of  Defense  was  the 
recognized  leader  in  the  application  of  Automatic  Data  Processing  (ADP) 
equipment  and  the  Department  of  Defense  (DoD)  was  responsible  for  many 
of  the  early  advances  in  computer  systems  development.  Since  about 
i960  the  position  of  the  Department  has  steadily  deteriorated  until,  at 
the  present  time,  it  owns  large  numbers  of  computers  in  various  stages 
of  obsolescence,  and  spends  at  least  $500  million  per  year  more  for 
computers  and  ADP  support  than  is  necessary.  The  justification  and 
selection  process  for  upgrading  present  equipment  or  for  new  applications 
currently  requires  millions  of  dollars  and  years  to  carry  to  a  conclusion. 

By  the  time  this  process  is  completed  for  a  particular  application,  the 
computer  requirements  in  the  majority  of  cases  will  have  changed  and  the 
equipment  to  be  installed  will  not  be  the  best  configuration  to  perform 
the  actual  workload.  When  compared  to  the  major  industrial  users  of 
computers,  the  Department  derives  much  less  benefit  from  its  ADP  dollar. 

No  industrial  user  could  afford  the  procurement  procedures  and  delays 
inherent  in  the  present  DoD  process. 

The  accounting  process  used  by  the  Department,  although  it 
satisfies  the  Department,  Bureau  of  the  Budget,  and  General  Accounting 
Office  requirements,  does  not  provide  the  data  required  for  procurement, 
usage,  or  disposition  of  computer  hardware  or  software.  The  Department 
has  effectiveness  criteria  for  aircraft,  missiles,  tanks,  and  other 
weapons  systems,  but  there  are  no  such  effectiveness  criteria  for  com¬ 
puters.  Therefore,  the  most  effective  method  available  to  the  Department 
in  evaluating  the  efficiency  of  ADP  operations  is  to  compare  the  Department's 
cost  to  industry's  costs. 
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Major  cost  structure  changes  in  the  field  of  computers  and  data 
processing  are  currently  underway.  For  the  last  few  years  most  computer 
users  leased  a  service  from  the  manufacturer,  which  included  the  use  of 
ADP  equipment,  software,  maintenance,  and  technical  support.  Policy 
changes  in  the  computer  industry  are  separating  these  elements  and  the 
user  will  no  longer  be  allowed  to  contract  for  a  "package  deal”.  These 
changes  place  much  more  urgency  on  the  development  of  more  sophistication 
and  technical  capability  within  the  Department.  Decisions  which  were 
dictated  by  the  manufacturers  will  now  be  under  the  control  of  the  user. 

At  the  present  time  the  Department  does  not  have  sufficient  technical 
capability  to  make  decisions  that  are  in  the  best  interest  of  the  Department. 

The  lack  of  effective  ADP  support  and  the  lack  of  management 
information  is  hampering  decisions  and  limiting  the  effectiveness  of 
management  within  the  Department.  This  need  for  more  effective  support 
cannot  be  satisfied  under  the  current  ADP  policies  and  management  guide¬ 
lines  . 

This  report  provides  information  concerning  the  current  procedures, 
DoD1 s  inventory  and  usage  of  ADP  equipment,  a  discussion  of  the  environment 
of  the  time  period  1970  to  1980,  and  makes  recommendations  for  changes 
which  will  provide  the  Department  with  more  ADP  capability  at  a  lower  cost 
and  provide  the  information  required  for  management  decisions. 

1. 1  Study  Procedures 

This  study  was  based  on  the  general  charter  of  the  Panel  but  with 
its  own  charter  (Figure  l).  A  list  of  21  areas  for  consideration 
(Figure  2)  was  developed. 
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Figure  1  -  Charter  for  ADP  Study  Group 


1.  Collect  information  concerning  the  applications ,  selection, 
justification,  management,  and  procurement  of  computer 
equipment. 

2.  Collect  information  concerning  the  approval  of  ADP  appli¬ 
cations  and  the  approval  cycle  for  equipment  purchase  or 
lease. 

3*  Determine  the  cost  of  ADP  activities,  including  the  cost 
of  hardware,  software,  and  operation. 

4.  Determine  the  interface  between  each  of  the  services,  the 
Office  of  Secretary  of  Defense,  and  the  General  Services 
Admin i s  t r a t i on . 

Based  on  the  findings  above,  determine  if  changes  in  the 
procedures  used  by  the  Department  can  result  in  significant 
savings . 

6.  Make  recommendations  to  implement  any  changes  that  will 
result  in  significant  improvements  in  the  operation  of  the 
Department. 

7.  Determine  if  the  Department  should  consider  the  use  of 
remotely  located  computers  and  communications  to  solve 
local  computer  requirements. 
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This  list  was  used  as  an  interview  guide  in  discussions  with  personnel 
in  each  of  the  Military  Departments,  Assistant  Secretary  of  Defense 
(Comptroller) (ASD(C)),  General  Services  Administration  (GSA), 

Bureau  of  the  Budget  ( BoB ) ,  and  the  Defense  Communications  Agency  (DCA). 
The  information  collected  during  these  interviews  and  obtained  from 
documents  provides  the  basis  for  this  report.  In  order  to  minimize 
the  time  requirements  on  Department  personnel,  the  interviewees  were 
not  asked  to  provide  written  responses  to  each  of  the  21  areas  under 
consideration.  The  Department  of  Defense  had  undertaken  a  similar  study 
during  1967.*  In  general,  the  conditions  at  the  present  time  are 
essentially  the  same  as  described  in  the  1967  report.  Extensive  dis¬ 
cussions  were  held  with  the  Chairman  of  the  1967  study  group.  The 
primary  result  of  their  study  was  to  originate  some  changes  to  DoD 
Directives  5100.40  and  4l05-55«  As  of  February  1970,  the  changes  were 
still  undergoing  review,  but  a  revised  DoD  Directive  5100.40  has  since 
been  issued  (l8  May  1970).  Another  change  which  has  occurred  since  the 
1967  report  has  been  the  transfer  of  staff  responsibility  for  ADP  to 
the  ASD(C)  from  ASD(l&L). 

1.2  Study  Constraints  and  Assumptions 

The  major  constraints  placed  on  this  study  were  those  resulting 
from  limitations  of  time  and  available  personnel.  The  study  assumed 
that  recommendations  could  be  made  to  any  area  where  substantial 
benefits  could  be  derived,  even  if  current  directives  and  statutes 
required  changes.  No  attempt  was  made  to  limit  the  study  scope  to  fit 

*Report  of  Assistant  Secretary  of  Defense  (installations  and  Logistics) 
a(l  hoc  study  group.  Computer  Selection  Policies,  Procedures,  and 
Techniques  in  the  Department  of  Defense,  July  1967.” 
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FIGURE  2 


AREAS  FOR  PANEL  CONSIDERATION 

1.  Justification  procedures  for  ADP  applications. 

2.  Justification  procedures  for  ALP  equipment. 

3*  Computer  selection  procedures. 

b.  Criteria  for  replacing/adding  computers. 

5.  Computer  procurement  procedures. 

6.  Criteria  for  retirement  of  computer  equipment. 

7.  Feasibility  of  establishing  a  list  of  acceptable  and  undesirable 
computers . 

8.  Feasibility  of  establishing  a  set  of  evaluation  programs  (benchmarks) 
for  adding  computers  to  the  list  of  acceptable  computers. 

9*  Use  of  time  sharing  vs.  locally  installed  equipment. 

10.  Evaluate  DoL  use  of  commercial  computer  services  for  some  uses  and 
establish  guidelines. 

11.  Establishment  of  mobile  computer  systems  which  could  be  used  to  support 
temporary  workloads  and  for  initial  workloads  for  new  installations. 

12.  Programming  languages  (Fortran,  COBOL,  PL/l,  Assembly). 

13.  Operating  systems  and  operating  procedures. 
lb.  Lata  storage  and  retrieval  software. 

15.  Feasibility  of  producing  "liberation”  programs  to  allow  some  older 
computers  to  be  retired  without  requiring  complete  reprogramming. 

16.  Establishment  of  common  ALP  systems  and  reports  within  the  Department. 

17.  Increased  program  exchange  between  installations. 

18.  Computer  use  reporting  and  installation  effectiveness  evaluation. 

19.  Administrative  responsibility  for  computers. 

20.  Computer  installation  operating  responsibility. 

21.  Feasibility  of  establishing  a  Defense  Communication  and  Computer 
Agency. 
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within  current  procedures,  assignments  of  responsibility,  or  directives. 

Assumptions  were  made  that  the  Department  would  continue  in 
its  major  roles  and  that  the  present  National  priorities  would  con¬ 
tinue.  It  was  also  assumed  that  the  Department  desired  to  make  the 
most  effective  use  of  its  resources  and  that  it  must  retain  the  capability 
to  rapidly  respond  to  unexpected  requirements. 

The  study  was  completed  within  this  framework  and  makes  recom¬ 
mendations  for  changes  which  will  provide  the  Department  with  effective 
and  efficient  ADP  support. 

1.3  Summary  of  Findings 

During  the  interviews  some  anticipated  and  some  unexpected  facts 
and  opinions  were  discovered.  This  section  gives  some  insights  into 
the  Department's  problems  which  were  discovered  during  the  interviews. 

The  comments  are  keyed  to  the  21  areas  (Figure  2). 

1.  Justification  procedures  are  too  involved  and  require  too 
much  time  and  resources.  Although  few  interviewees  had 
concrete  suggestions  for  improvements,  all  agreed  that 
some  changes  were  required. 

2.  Same  comments  as  1  above. 

3.  The  selection  process  has  often  resulted  in  equipment  which 
did  not  meet  requirements  when  it  was  installed.  This 
resulted  partially  from  the  long  time  delays  between 
recognition  of  the  requirement  and  installation  of  the 
equipment. 
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4. 


There  are  no  criteria  for  replacing  computers.  If  a 
computer  system  will  no  longer  carry  the  workload,  it 
is  frequently  augmented  "by  the  addition  of  another  identical 
computer.  The  Department  of  Defense  has  many  computers 
which  have  been  in  use  for  over  10  years . 

5.  Computer  procurement  is  largely  handled  by  the  General 
Services  Administration  and  eventually  they  will  handle 
all  procurements. 

6.  See  comment  4  above.  There  are  no  criteria  for  retirement 
of  computer  equipment. 

7.  All  computers  are  assumed  to  be  acceptable  to  the  Depart¬ 
ment  and  the  selection  is  made  from  the  bids  submitted. 

8.  If  the  Department  feels  a  demonstration  of  capability  is 
required,  benchmarks  are  included  in  the  procurement  specifi¬ 
cations.  The  Department  selects  computers  to  perform  approved 
functions  on  the  basis  of  system  specifications  and  cost  of 
the  proposed  system.  It  does  not  select  equipment  based  on 
general  performance  vs.  cost  evaluations. 

9.  Concern  was  voiced  on  the  use  of  a  priority  system  which 
would  allow  work  to  be  completed  when  required. 

10.  DoD  components  currently  use  some  commercial  computer  services 
but  there  are  no  DoD  guidelines  or  directives  concerning  their 
use.  In  most  cases,  gaining  approval  for  the  use  of  these 
services  is  easier  than  purchasing  equipment. 
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11.  No  comments  of  significance  were  made  on  this  subject. 

12.  Programming  languages  and  programs  were  discussed  with  all 
interviewees . 

Some  of  the  viewpoints  were  as  follows: 

a.  The  Department  requires  business  data  processing  pro¬ 
grams  to  "be  written  in  COBOL  unless  substantial 
savings  will  result  from  other  languages. 

b.  COBOL  has  been  in  existence  for  some  time  and  other 
higher  level  languages  provide  more  capability. 

c.  Perhaps  COBOL  was  premature  and  the  Department  should 
have  waited  before  making  it  the  standard. 

d.  Programs  written  in  COBOL  are  easier  to  change  than  pro- 
grams  written  in  assembly  language. 

e.  COBOL  programs  require  from  1.5  to  10  times  more  com¬ 
puter  capability  than  assembly  language  programs. 

f.  FORTRAN  is  the  common  scientific  processing  language 
within  the  Department,  and  it  seems  to  be  satisfactory 
since  it  has  been  updated  and  expanded  on  several 
occasions . 

13.  Operating  systems  are  the  responsibility  of  the  supplier  and 
the  Department  does  not  undertake  to  provide  its  own. 

14.  Data  storage  and  retrieval  software  is  the  major  software 
problem  of  the  Department.  Millions  of  dollars  have  been 
spent  and  many  more  millions  will  be  required  before  there 
is  a  suitable  system  developed. 
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15.  The  Department  has  met  with  some  degree  of  success  in  this 
area  but  efficient  use  of  the  new  computer  is  the  major 
problem.  Also  some  manual  work  may  be  required  for  some 
conversions . 

1 6.  Common  ADP  systems  and  reports  within  the  Department  must 
wait  for  resolution  of  differences  between  each  of  the 
Military  Departments  and  other  components  before  they  can  be 
developed.  Common  management  systems  do  not  currently  exist. 

IT*  Increased  program  exchange  is  not  possible  until  differences 
are  removed  between  the  DoD  components . 

18.  Computer  hours  per  month  and  manpower  directly  relatable  to 
computers  are  currently  being  reported.  There  are  no 
criteria  for  installation  effectiveness,  and  continuing  cost 
effectiveness  analysis  is  not  undertaken. 

19>  Administrative  responsibility  rests  with  the  Military  Depart¬ 
ments  and  other  DoD  components .  The  Office  of  the  Secretary 
of  Defense  (OSD)  is  involved  only  in  selection  and  procure¬ 
ment,  and  in  budget  approval. 

20.  See  19  above. 

21.  No  comments  were  made  except  questions  concerning  its 
operation. 

2.0  DOD  COMPUTER  INVENTORY,  USAGE,  AND  MANAGEMENT 

2.1  Current  Inventory  of  Computers 

The  Department  of  Defense  currently  has  approximately  2800 
computers  which  are  used  for  general  purpose  data  processing.  Figure  3 
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shows  the  number  of  computers  within  the  Department  for  each  manufacturer 
and  model  designation.  Several  of  these  computers  are  obsolete  and 
these  are  indicated  by  an  asterisk  (*)  following  the  model  number.  The 
definition  of  the  term  varies  with  individuals  but  the  equipment  indi¬ 
cated  in  this  list  would  be  considered  obsolete  by  most  computer 
personnel.  A  computer  which  is  no  longer  manufactured  is  not  considered 
obsolete  if  it  is  still  capable  of  performing  work  efficiently.  All  of  the 
Department's  computers  are  not  shown  on  this  list  since  some  are  used  for 
classified  work  and  this  list  was  taken  from  unclassified  sources.  Of 
the  computers  listed,  1019  (36$)  are  considered  obsolete.  Some  of  the 
computers  listed  are  normally  considered  as  process  control  types  and 
they  are  commonly  not  used  for  general  purpose  data  processing.  Examples 
of  process  control  type  computers  are  SDS  910,  920,  PDP  8,  etc. 

An  inventory  of  ADP  equipment  within  the  Department  of  Defense 
was  obtained  from  the  General  Services  Administration  (GSA)  based  on  data 
supplied  to  GSA  by  the  Department  of  Defense.  This  inventory  provided 
data  in  three  arrangements:  First,  by  geographical  location;  second, 
by  manufacturer  and  model  number;  and  third,  by  hours  used  per  month. 

The  Department's  procurement  policies  have  resulted  in  multiple 
computers  of  the  same  type  in  the  same  locations.  Figure  h  shows  some 
examples  of  this  duplication.  It  is  a  commonly  accepted  fact  that 
doubling  the  thru-put  of  a  computer  installation  can  be  achieved  with, 
an  increase  of  only  20$  to  50$  in  cost  if  a  larger  computer  is  used. 

However,  one  factor  which  must  be  included  in  this  trade-off,  is  the 
difficulty  and  cost  of  reprogramming  in  the  event  that  the  new  computer 
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FIGURE  3 

DOD  COMPUTER  INVENTORY  AS  OF  30  JUNE  1969 
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642A 

3 

CDC 

4ooo 

l 

HON 

4oo* 

4 

NCR 

315 

7 

UNI 

642B 

9 

[  CDC 

4oio 

l 

HON 

800* 

18 

NCR 

390 

138 

UNI 

667 

l 

1  CDC 

5350 

l 

HON 

DDPI16 

7 

NCR 

500 

118 

UNI 

818 

l 

CDC 

64oo 

l 

HON 

DDP224 

4 

NDI 

3300 

1 

UNI 

855 

3 

|  CDC 

6500 

2 

HON 

DDP24 

5 

PHI 

1000* 

4 

UNI 

9300 

10 

CDC 

6600 

4 

HON 

DDP516 

3 

PHI 

2000 

5 

UNI 

DCT9000 

1 

CDC 

8o4i 

1 

HPC 

HP2116 

3 

RAY 

250* 

7 

UNI 

III* 

6 

CDC 

8090 

19 

IBM 

1130 

22 

RAY 

44o 

1 

UNI 

m46o 

l 

CDC 

8092B 

7 

IBM 

1401 

259 

RAY 

520 

3 

UNI 

ss8o* 

2 

'  CDC 

924a* 

1 

IBM 

1410 

6l 

RCA 

301* 

100 

UNI 

SS90* 

1 

CDC 

G15D* 

25 

IBM 

i44o 

19 

RCA 

3301 

25 

VAR 

6201 

1 

l  CDC 

LGP21* 

2 

IBM 

l46o 

30 

RCA 

501* 

26 

f  CDC 

LGP30* 

10 

IBM 

1500 

2 

RCA 

7035 

2 

*  Indicates  an  obsolete  computer 


I 
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is  not  program-compatible  with  the  older  one.  The  Department's  approval 
and  selection  policies  have  been  directed  toward  matching  the  computer 
to  an  approved  workload  and  then  installing  this  computer  in  each 
location  which  had  this  function  to  perform.  Therefore,  no  attempt 
has  been  made  to  reduce  the  number  of  computers  at  these  installations. 
Where  large  numbers  of  computers  are  installed  at  a  geographical  location, 
the  number  of  personnel  and  the  cost  of  operating  the  installation  could 
be  greatly  reduced. 

As  can  be  seen  in  Figure  4,  there  are  installations  which  have  7* 

8,  or  9  computers  of  the  same  type,  some  of  which  are  owned  and  some  are 
leased.  These  RCA  301  installations  are  typical  of  the  results  of 
selecting  computer  equipment  to  meet  workload  units,  and  then  installing 
this  equipment  without  regard  to  the  total  requirements  for  computer 
support. 

Figures  5  through  8  show  computers  installed  in  four  different  geo¬ 
graphical  locations.  Figure  8  shows  the  computers  installed  in  the 
vicinity  of  Norfolk,  Virginia.  There  is  not  a  single  modern  large  scale 
computer  included  in  this  list,  and  of  the  82  computers  shown, 
approximately  half  would  be  considered  obsolete  by  most  computer  personnel. 

The  present  policies  within  the  Department  result  in  the  selection 
and  use  of  medium  scale  computers  dedicated  to  performing  independent 
functions.  The  latest  computer  inventory  (June  30,  19^9)  shows  the 
following  large  scale  computer  installations  within  the  Department: 


CDA  6000  Series 

7 

GE  600  Series 

5 

IBM  360/65  and  larger 

27 

IBM  7080/90/94 

64 

UNTVAC  1108 

10 

TOTAL 

113 
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FIGURE  4 

INSTALLATIONS  OF  RCA  301  COMPUTERS 


Avg. 

Mthly. 

.  Hrs .  io 

City/Post  Office  Command  Qty.  Owned  Rented  In  Svc.  Utiliz. 


Maxwell  AFB 

Air  University 

1 

1 

+ 

126 

18.0 

McClellan  AFB 

Ass't,  Dir.  Plan  Programs  Sys. 

4 

2 

2 

694 

99-2 

It  tl 

Air  Force  Logistics  Command 

7 

4 

3 

bkk 

63.5 

tt  YY 

AF  Communications  Command 

1 

-f 

1 

NA 

Presidio  San  Fran 

Sixth  US  Army 

1 

+ 

1 

328 

46.9 

San  Diego 

Commander  in  Chief  PAC  Fleet 

1 

1 

+ 

537 

76.8 

Denver 

AF  Account  and  Fin.  Ctr. 

1 

1 

+ 

365 

52.2 

it 

Office  of  the  Surgeon  General 

1 

1 

+ 

193 

27.6 

Washington 

Bureau  of  Naval  Personnel 

1 

1 

219 

31.3 

YY 

Chief  of  Naval  Material  NEC 

1 

1 

+ 

446 

63.8 

YY 

Naval  Communications  Command 

1 

+ 

1 

172 

24.6 

Ft.  McPherson 

Third  US  Army 

1 

+ 

1 

623 

89.1 

Robins  AFB 

Air  Force  Logistics  Command 

8 

5 

3 

450 

64.4 

Heidelberg,  Germany 

US  Army  Europe 

3 

+ 

2 

621 

88.8 

Ft.  Shafter 

US  Army  Pacific 

1 

+ 

1 

567 

8l.l 

Honolulu 

Naval  Communications  Command 

1 

+ 

1 

447 

63.9 

Ft.  Sheridan 

Fifth  US  Army 

1 

+ 

1 

556 

79-5 

Joliet 

US  Army  Munitions  Command 

2 

1 

1 

687 

98.2 

Rock  Island 

US  Army  Weapons  Command 

2 

2 

+ 

508 

72.6 

Scott  AFB 

AF  Communication  Service 

1 

1 

+ 

379 

54.2 

Edgewood  Arsenal 

Office  Adjutant  General 

1 

+ 

1 

682 

97-5 

Ft.  Geo.  G.  Meade 

First  US  Army 

1 

+ 

1 

681 

97.4 

Warren 

US  Army  Tank  Auto.  Command 

3 

2 

1 

570 

81.5 

Kansas  City 

Office  Chief  of  Engineers 

1 

+ 

1 

398 

56.9 

St.  Louis 

ACIC 

1 

1 

+ 

330 

47.2 

YY  YY 

Office  Adjutant  General 

1 

+ 

1 

542 

77-5 

YY  YY 

Office  Chief  of  Eng. 

1 

+ 

1 

302 

43.2 

Omaha 

tr  n  ri  n 

1 

1 

+ 

501 

71.6 

McGuire  AFB 

Military  Airlift  Command 

1 

+ 

1 

313 

44.8 

Griffis s  AFB 

Air  Force  Logistics  Command 

1 

1 

+ 

599 

85.7 

Gentile  AFS 

AssTt.  Dir.  Plan  Programs  Sys. 

9 

3 

6 

700 

100.0 

Newark 

Air  Force  Logistics  Command 

2 

2 

+ 

637 

91.1 

Wright  Patterson 

11  u  it  11 

6 

3 

3 

309 

44.2 

Tinker  AFB 

n  11  it  it 

8 

5 

3 

466 

66.6 

11  it- 

"  Communications  Command 

1 

+ 

1 

NA 

_  _ 

Philadelphia 

AssTt.  Dir.  Plan  Programs  Sys. 

2 

1 

1 

702 

100.0 

Kelly  AFB 

Air  Force  Logistics  Command 

8 

5 

3 

501 

71.6 

Hill  AFB 

AF  Communications  Command 

1 

+ 

1 

NA 

_  _ 

It  II 

Air  Force  Logistics  Command 

7 

4 

3 

368 

52.6 

Ft.  Belvoir 

US  Army  Mobility  Eq.  Command 

1 

+ 

1 

229 

32.7 

Norfolk 

Commander  in  Chief  LANT 

1 

1 

+ 

272 

38.9 

Long  Binh 

US  Army  Pacific 

2 

+ 

2 

397 

56.7 

Total 

99 

50 

49 

486 

69.5 
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Figure  5  -  Computers  Installed  In  the  Boston  Area 


(Bedford,  Boston,  Cambridge, 
Natick,  Otis,  Waltham) 

Chelsea,  Ft. 

Model 

Devins,  ! 

Hans com  Field 

Avg. 

Hours 

Manufac turer 

No. 

Quantity 

in  Svc. 

DEQ 

It 

PDPl 

5 

270 

II 

PDP7 

3 

221 

PDP8 

l 

120 

PDP8L 

2 

NA 

LINC8 

2 

NA 

IBM 

1130 

1 

NA 

1401 

1 

184 

1410 

2 

224 

IT 

l46o 

1 

471 

II 

1800 

1 

221 

If 

7030 

1 

335 

II 

7044 

1 

579 

ft 

7094 

1 

573 

7094  II 

1 

186 

36020 

2 

131 

36030 

1 

164 

36o4o 

1 

464 

36050 

2 

4o6 

SDS 

II 

36067 

1 

668 

920 

1 

152 

II 

93001 

1 

242 

f| 

SIGMA2 

1 

NA 

SGD* 

II 

SIGMA5 

1 

NA 

CAMC 

1 

NA 

T2 

1 

373 

Un i vac 

If 

490 

1 

277 

Tl 

1004 

3 

136 

If 

1005 

2 

283 

It 

1050 

2 

450 

ft 

1050  III 

1 

687 

II 

III 

1 

694 

II 

1218 

1 

200 

II 

1219 

1 

525 

CDC 

11 

m46o 

1 

125 

3200 

1 

105 

ii 

3300 

1 

407 

ti 

536o 

1 

176 

ii 

8092B 

1 

NA 

LPG30 

1 

21 

Honeywell 

200 

1 

339 

ft 

2200 

1 

516 

DDP224 

3 

374 

Burroughs 

ff 

DDP516 

l 

150 

B263 

l 

198 

RAY 

B3500 

2 

NA 

70L 

1 

NA 

SEL 

810A 

2 

232 

VAR 

6201 

1 

544 

GE 

225 

2- 

451 

NCR 

390 

1 

238 

Total 

^Special  Government  Design 

14 

TO 

309 

Lexington, 


* 

Utiliz. 

36.8 

31-6' 

1T.2 


26.3 
32.0 
81.6 
31-6 

47.9 

82.8 

81.9 

2  6.6 

18.7 

23.4 
66.1* 
58.1 

95-5 

21.7 
34.6 


53-3 

39-6 

19.5 

40.5 

64.4 

98.2 

99-2 

28.6 
75-1 
17.9 
15.0 

58.2 

25.2 

3.0 

48.5 
73-8 
53-5 

21.5 

28.3 


33-2 

77.8 

64.5 

34.0 

44.2 


Figure  6  -  Computers  Installed  in  Hawaii  (Oahu) 


(Barbers  Point,  Ft.  Shatter,  Helemana,  Hickam  APB,  Honolulu,  Kaneohe  Bay, 
Kunia,  Oahu,  Pearl  Harbor,  Wakiawa,  Wheeler  AFB) 


Manufacturer 

Model 

No. 

Quantity 

Avg. 

Hours 
in  Svc. 

1° 

Utiliz 

IBM 

1130 

3 

108 

15.4 

II 

i4oi 

7 

391 

55-9 

II 

i4io 

5 

516 

73-8 

tl 

1460 

2 

603 

86.2 

tl 

7010 

2 

692 

98.9 

tl 

7740 

1 

NA 

II 

36020 

5 

449 

64.2 

tl 

36030 

1 

NA 

— 

II 

36o40 

2 

NA 

— 

II 

36050 

3 

576 

82.4 

RCA 

301 

2 

507 

72.5 

II 

501 

2 

560 

80.I 

SGD* 

ANUYK5V 

2 

493 

70.5 

Uni vac 

1004 

7 

255 

36.5 

tl 

1005  III 

1 

185 

26.5 

tt 

1050 

2 

654 

93.5 

II 

1050  III 

1 

352 

50.3 

CDC 

l6o4 

5 

342 

48.9 

II 

160A 

5 

537 

76.8 

II 

3100 

3 

687 

98.2 

II 

8090 

3 

191 

27.3 

tl 

8490 

1 

612 

87.5 

NCR 

390 

2 

230 

32.9 

Total 

67 

429 

61.3 

*Speeial  Government  Design 
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Figure  J  -  Computers  Installed  in  the  St.  Louis*  Area 


Manufacturer 

Model 

No. 

Quantity 

Avg. 

Hours 
in  Svc. 

* 

Utiliz. 

Autonutics 

REC2 

4 

31 

4.4 

Burroughs 

B263 

2 

151 

21.6 

M 

B3500 

2 

NA 

-- 

Honeywell 

200 

3 

489 

70.0 

n 

1200 

1 

442 

63.2 

m 

800 

1 

498 

71.2 

IBM 

1401 

5 

448 

64.1 

11 

1410 

2 

360 

51.5 

II 

1440 

3 

474 

67.8 

II 

1620 

1 

146 

20.1 

11 

36020 

1 

NA 

-- 

11 

36030 

2 

652 

93-2 

11 

36040 

1 

200 

28.6 

11 

36050 

3 

625 

89.4 

II 

36065 

5 

434 

62.1 

11 

7010 

2 

661 

94.5 

11 

7080 

1 

694 

99-2 

It 

7094 

3 

457 

65-3 

NCR 

390 

2 

213 

30.5 

CDC 

8092B 

1 

139 

19.9 

Philco 

1000 

1 

221 

31-6 

It 

2000 

1 

287 

4l.O 

RCA 

301 

1 

330 

47.2 

II 

501 

1 

338 

48.3 

Un ivac 

4l8 

1 

NA 

-- 

ii 

1004 

4 

658 

93-2 

it 

1050 

1 

473 

67.6 

ii 

1108 

2 

653 

93-^ 

Total 

57 

423 

60.5 

*St.  Louis  and  Scott  AFB 
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Figure  8  -  Computers  Installed  in  the  Norfolk  Area 


(Ft.  Eustis ,  Ft.  Monroe,  Hampton,  Langley  AFB,  Little  Creek,  Norfolk, 
Portsmouth,  Virginia  Beach,  Yorktown) 


Avg. 

Model  Hours  $ 


Manufacturer 

No. 

Quantity 

in  Svc. 

Utiliz. 

IBM 

1130 

1 

147 

21.0 

II 

1620 

1 

81 

11.6 

II 

1401 

9 

396 

56. 6 

ir 

1410 

2 

456 

65.2 

ii 

36020 

2 

435 

62.2 

ii 

36030 

3 

445 

63.6 

H 

36025 

1 

NA. 

— 

li 

36o4o 

1 

514 

73-5 

ri 

36050 

1 

NA 

il 

64oo 

2 

174 

24.9 

il 

7010 

1 

536 

76.6 

ii 

7o4o 

1 

519 

74.2 

il 

7740 

1 

491 

70.2 

Un  i* vac 

ioo4 

8 

289 

41.3 

ii 

1005 

3 

336 

48.0 

it 

1050  hi 

l 

430 

61.5 

ii 

ill 

l 

580 

82.9 

ii 

1051 

l 

NA 

ii 

HOT 

l 

NA 

— 

Honeywell 

200 

5 

548 

78.4 

ii 

1200 

3 

515 

73-7 

ii 

800 

3 

503 

71.9 

Burroughs 

B263 

2 

NA 

-- 

ii 

B3500 

1 

500 

71.5 

NCR 

390 

3 

453 

64.8 

II 

500 

2 

183 

26.2 

RCA 

301 

1 

272 

38.9 

II 

3301 

1 

698 

99-8 

II 

501 

1 

308 

44.0 

II 

7045 

2 

648 

92.7 

SGD* 

ANUYK5V 

4 

466 

66.6 

II 

ANUYK4V 

1 

526 

75-2 

CDC 

l6o4 

3 

553 

79-1 

II 

160A 

5 

24o 

34.3 

II 

310Q 

2 

628 

89.8 

II 

8090 

1 

361 

51.6 

II 

8490 

1 

545 

77.9 

Total 

82 

4l6 

59-5 

*Special  Government  Design 
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Some  samples  of  medium  scale  computer  inventory  are  as  follows: 


CDC  3000  Series 

73 

Honeywell  800/l800 

20 

IBM  l4l0 

6l 

IBM  360/30-40 

105 

IBM  7010 

21 

RCA  301 

100 

RCA  501 

26 

Burroughs  3500/5500 

21 

2.2  Current  Computer  Usage. 

Large  numbers  of  the  Departments  computers  are  used  less  than  1 6 
hours  per  day.  As  can  he  seen  in  figure  b  there  are  some  installations 
where  there  are  multiple  computers  of  the  same  type,  some  of  which  are 
leased  and  some  of  which  are  owned.  In  these  installations,  the  average 
use  indicates  that  one  or  more  of  the  leased  computers  could  he  returned, 
and  the  workload  could  he  performed  hy  the  remaining  computers  hy  using 
them  more  hours  per  day.  This  is  the  result  of  two  factors;  first,  the 
delays  in  obtaining  computer  equipment  demands  that  some  idle  computer 
time  he  saved  for  future  requirements,  and  second,  restrictions  on  the 
use  of  overtime  does  not  allow  the  necessary  operating  personnel  to 
operate  the  computer  2b  hours  per  day  and  seven  days  per  week.  If 
computers  could  he  obtained  when  needed,  and  personnel  were  available 
to  operate  them,  substantial  savings  could  he  achieved.  The  inventory 
referred  to  earlier  indicates  average  computer  usage  during  FY  69  for 
those  DoD  computers  which  reported  time  used.  Several  computer  instal¬ 
lations  are  exempt  from  time  reporting  requirements. 
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So  long  as  the  present  policies  are  in  effect  within  the  Department, 
it  is  not  likely  that  these  usage  hours  can  or  should  he  increased. 

2.3  Current  Management  Techniques 

DoD  computers  are  currently  managed  by  the  component  where  the 
computer  is  installed.  Inventory  and  usage  data  is  reported  and  this 
data  becomes  a  part  of  the  " Inventory  of  Automatic  Data  Processing 
Equipment  in  the  United  States  Government"  which  is  published  by  the 
General  Services  Administration  for  each  fiscal  year.  Personnel  and 
financial  information  is  also  reported  annually  and  is  included  in  the 
inventory. 

Figure  9  gives  the  summary  data  for  FY  68,  FY  69,  and  projected  data 
for  FY  70.  The  projected  total  for  FY  70  is  $1,381  billion,  which  does 
not  include  the  cost  of  capital  invested  in  owned  computers.  The  Depart¬ 
ment  of  Defense  owns  1212  computers,  and  by  a  rough  estimate,  each  cost 
approximately  $750,000.  If  the  cost  of  invested  capital  is  8$,  then  a 
total  of  $91  million  results.  The  depreciation  cost,  based  on  an 
expected  life  of  5  years,  is  $182  million,  totalling  $273  million  which 
is  not  included  in  figure  9*  The  salaries  are  reported  at  $721  million 
but  the  average  cost  per  man  year  is  reported  at  $8278.  This  average 
salary  does  not  include  normal  overhead  items  such  as  fringe  benefits, 
cost  of  facilities,  cost  of  other  supporting  personnel,  etc.  A  rough 
guess  would  place  this  figure  at  5 0$  of  direct  salaries,  giving  a  total 
labor  cost  of  $1.08  billion,  and  making  the  estimated  total  cost  of 
computers  $2  billion  for  FY  70. 
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Figure  ^  -  Summary  Data  from  GSA  "inventory 
of  Automatic  Data  Processing  Equipment 
in  the  United  States  Government" 


FISC AL  year  63  (fi:;al) 

FISCAL  YEAH  69 

FISCAL  YEAR  70  (PROJECTED) 

DOD 

TOT 

DOD 

TOTAL 

DOD  £ 

DOD 

to;; 

DOD 

TOTAL 

DOD  g 

DCD 

I 

DOD 

;  TOTAL  | 

!  DOD 

'Total  ADPCost  (Millions) 

1,003 

650 

1,653 

60.7 

1,218 

720 

1,933 

62.3 

1,381 

J 

820 

i 

2,201  j  62.7 

Ssl&TiCS 

536 

302 

838 

64.0 

64i 

355 

996 

64.4  j 

1 

721 

4u2 

1,133  | 

|  63  6 

Rentals 

221 

91 

312 

70.8 

.  261 

92 

353 

73-9 

! 

319 

93 

;i7 

?8  5 

Contract  Service 

98 

105 

203 

48.3 

149 

123 

272 

54.8 

143 

130 

273  | 

|  52.. 

Capital  Cost 

~FT 

93 

160 

41.9 

63 

ICO 

163 

33.6 

71 

122 

1 

♦  V* 

1 

Other  Cost 

5 ~ 

59 

mo 

57.9 

104 

53 

157 

66.2 

127 

53 

135  j  CO . 6 

ftsibcr  of  Kan/year 3 

76,6x7 

42,196 

118,813 

64.5 

81, 860 

45,809 

127,749 

64.1 

37,170 

49,334  1 

i 

Il36,504  ! 

1 

l  --  r 

c"  j.ve  Cost  per  Mcn/y car 

7,000 

7,173 

7,054 

:;/a 

7,036 

7,751 

7,300 

;:/a 

8,278 

3,557 

1  -  . 

|  0  , 3 

| 

ro - — — - - — - 

°  Inventory  by  KFR 

1 DM 

Control  Data 

*  *-«T5 

U1TVAC 

Burroughs 

Koneyveii 

Digital  Equip  Corp 

Scientific  Data 

All  Others 

732 

223 

247 

719 

143 

134 

ill 

26 

27 

277 

463 

177 

2 

184 

23 

9 

136 

133 

159 

187 

1,200 

4C0 

249 

903 

176 

193 

247 

214 

I06 

4  64 

£  of  DOD 
TOTAL 

27.1 

3-3 

9*2 

26.7 

5*5 

6.8 

4.1 

1.0 

1.0 

10.3 

737 

226 

287 

757 

157 

133 

127 

29 

33 

325 

524 

176 

1 

193 

32 

7 

144 

302 

176 

213 

1,312 

404 

263 

950 

189 

195 

271 

331 

209 

538 

of  DOD 
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Figure  9  Cont'd  -  Summary  Data  from  GSA  "inventory 
of  Automatic  Data  Processing  Equipment 
In  the  United  States  Government" 
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Since  each  of  the  Military  Services  and  DoD  components  is 
responsible  for  the  management  of  computers  in  its  area  of  responsibility, 
there  is  no  office  within  the  Department  of  Defense  which  has  responsi¬ 
bility  for  minimizing  the  total  cost  of  computers.  Most  of  the  manage¬ 
ment  effort  within  the  Department  is  directed  toward  selecting 
computers,  justification  of  these  selections,  and  the  preparation  of 
directives  and  policy  statements. 

The  present  procurement  and  selection  procedures  are  based  on  the 
concept  of  a  computer  system  for  a  set  of  clearly  defined  applications. 
These  applications  are  defined  and  a  cost  analysis  is  undertaken  to 
determine  how  much  the  proposed  system  will  cost  and  what  benefits  will 
be  derived  from  the  use  of  the  computer.  The  Department  also  makes  an 
analysis  to  determine  if  lease  or  purchase  is  desirable  for  each  procure¬ 
ment,  but  it  considers  only  the  workload  of  the  component  which  generates 
the  requirement.  Sharing  a  computer  with  another  element  in  order  to 
take  advantage  of  the  reduced  cost  per  job  on  larger  computers  is  not 
considered  in  making  the  selection.  In  fact,  in  many  cases  multiple 
computers  of  the  same  type  are  installed  in  the  same  location.  Depart¬ 
ment  of  Defense  Instruction  5030.40  details  how  charges  can  be  made  for 
shared  resources.  Basically,  the  policy  is  to  charge  only  for  direct 
out-of-pocket  costs  which  makes  the  sharing  unattractive  for  the  agency 
with  excess  computer  time. 

The  direct  costs  of  the  Military  Department's  ADP  management  and 
selection  are  shown  in  Figure  10. 

System  specifications,  which  are  the  primary  documentation  used  for 
computer  procurement,  for  a  small  to  medium  scale  computer  may  require 
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FIGURE  10 
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several  man-years  to  complete,  and  can  cost  several  hundred  thousands 
of  dollars.  The  specifications  for  the  CS3  computer  system  are  five 
inches  thick  and  were  used  to  procure  an  IBM  36o/40  computer  system. 
These  specifications  are  dated  August  1966,  and  as  of  February  1970* 
the  system  was  not  yet  fully  operational. 
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3.0  JUSTIFICATION,  SELECTION,  AND  PROCUREMENT  PROCEDURES 


3.1  Current  Procedures. 

Present  justification,  selection,  and  procurement  procedures  for 
ADP  equipment  within  the  Department  of  Defense  are  based  on  the  pro¬ 
visions  of  Bureau  of  the  Budget  Circular  No.  A- 5^-. 

The  Office  of  the  Assistant  Secretary  of  Defense  (Comptroller) 
and  each  of  the  Military  Departments  has  issued  instructions  which 
establish  procedures  intended  to  assure  that  the  computer  is  used  for 
beneficial  applications  and  that  the  selection  process  provides  the 
necessary  capability  at  the  lowest  cost  and  promotes  competition  between 
vendors . 

System  specifications  basically  consist  of  detailed  information  con¬ 
cerning  the  application  which  the  computer  will  perform.  This  description 
can  be  as  large  as  several  thousand  pages  and  includes  each  input-output 
and  file  description,  estimates  of  the  number  of  instructions  in  each 
program  or  sub-routine,  the  frequency  of  use  of  each  sub-routine  or 
program,  the  number  of  characters  in  each  record,  and  the  number  of 
records  in  each  file.  The  file  descriptions  also  include  whether  the 
character  is  alpha  or  numeric. 

If  the  computer  is  used  for  a  new  application,  the  effort  required 
to  complete  the  selection  documents  can  be  as  large  as  the  effort  required 
to  actually  prepare  the  programs.  The  cost  of  this  work  is  approximately 
the  same  as  the  actual  cost  of  the  equipment. 

In  addition  to  the  descriptions  of  the  inputs,  outputs,  and  files, 
flow  diagrams  are  required  for  each  program  or  sub-routine.  These 
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descriptions  are  also  used  to  determine  whether  a  computer  application 
should  "be  approved  and  therefore  becomes  a  first  step  in  any  selection 
of  computers  by  the  Department.  Needless  to  say  this  system  has  not 
worked  effectively  and  its  use  causes  delays  of  two  to  three  years 
in  the  procurement  of  the  computer.  In  the  past,  the  Department  has 
even  attempted  to  use  this  same  procedure  to  obtain  equipment  to  be 
used  for  research  and  development  centers. 

These  descriptions  are  sent  to  the  computer  manufacturers  and 
they  then  propose  to  provide  equipment  which  will  perform  the  work 
described  and  the  Department  often  buys  the  lowest  priced  proposed 
system. 

The  major  difficulty  involved  in  the  justification  and  selection 
process  is  the  time  required  to  complete  the  process  and  the  difficulty 
of  predicting  the  workload  with  sufficient  accuracy  to  select  the  ADP 
system  which  adequately  meets  the  requirements  over  the  life  span  of 
the  equipment.  The  vast  majority  of  estimates  are  lower  than  the  actual 
workload,  and  this  causes  the  system  to  be  too  small  to  perform  all  the 
required  functions. 

In  many  cases  the  selection  is  made  by  personnel  who  have  no  first  - 
hand  knowledge  of  the  workload  but  depend  entirely  on  the  description  of 
the  applications. 

This  process  has  caused  the  Department  of  Defense  some  difficulties 
in  the  past  and  in  several  cases  the  computer  equipment  selected  by  this 

process  has  been  too  small  to  carry  the  workload  for  even  the  first  year. 
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There  is  general  agreement  among  Department  of  Defense  personnel  that 
the  procedures  are  too  complex  and  time  consuming.  Information 
obtained  from  vendors  by  an  'in-house'  study  group  also  indicates  that 
vendors  feel  the  system  is  too  expensive  and  time  consuming,  and  that 
the  procedures  limit  competition  between  vendors. 

In  an  attempt  to  reduce  the  problems  inherent  in  these  system 
specifications,  the  Department  of  Defense  at  other  times  has  used  other 
means  of  computer  selection.  The  primary  alternative  has  been  the  use 
of  the  benchmark.  A  benchmark  is  a  typical  computer  workload  either 
selected  from  the  present  computer  workload  or  is  generated  from  a 
knowledge  of  the  type  of  work  the  new  computer  will  perform.  These 
benchmarks  require  less  time  and  effort  to  prepare  than  the  system 
specifications,  but  they  also  require  substantial  investments  by  potential 
vendors  for  programming,  debugging,  and  machine  time  for  running  these 
benchmarks.  In  general,  some  difficulties  result  from  the  failure  of 
most  benchmarks  to  truly  represent  the  actual  computer  workload.  The 
same  problems  of  estimating  the  workload  during  the  system  life  exist 
for  this  method  as  exist  for  the  system  specifications.  In  general, 
forecasting  the  future  is  difficult  and  most  likely  incorrect,  and 
computer  workload  forecasts  are  no  exception. 

In  a  recent  procurement  (Air  Force  Logistics  Command  ESQ  Project 
^3-67 )  the  Air  Force  based  a  major  procurement  on  in-house  system 
design  and  benchmarks  for  selection  of  the  computer  system.  In  this 
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procurement,  a  determination  was  made  as  to  the  system  configuration 
and  capacity  required  before  the  procurement  -was  released  for  bids. 

The  elapsed  time  between  the  preparation  of  the  first  documenta¬ 
tion  describing  a  computer  requirement  and  the  installation  of  the 
equipment  varies  between  a  minimum  of  two  years  and  a  maximum  of  at 
least  six  years.  This  time  is  used  in  the  preparation  of  the  justifi¬ 
cation  documents,  the  system  specifications,  soliciting  bids  from 
vendors,  evaluating  proposals  from  vendors,  and  obtaining  equipment. 
Often  it  is  necessary  to  repeat  one  or  more  of  these  steps.  During 
each  visit  of  the  computer  task  group  to  DoD  personnel,  comments  were 
received  concerning  the  delays  in  obtaining  computer  hardware. 

The  computer  workload  is  a  dynamic  and  changing  requirement,  and 
often  by  the  time  the  computer  has  been  installed,  the  workload  is 
significantly  different  than  the  one  anticipated  at  the  time  the 
computer  procurement  began.  The  time  required  to  change  the  documenta¬ 
tion  is  almost  as  long  as  the  initial  preparation.  Therefore,  often 
the  requirement  is  not  updated  during  the  procurement  cycle  and  the 
system  effectiveness  may  not  be  as  high  as  it  could  have  been.  If  the 
DoD  is  to  have  effective  and  efficient  computer  support  of  its  missions, 
the  time  delays  in  obtaining  computer  support  must  be  greatly  reduced. 
3.2  Effects  of  Current  Procedures  on  the  Department 

The  current  procedures  result  in  major  inefficiencies  within  the 
Department , caused  primarily  by  the  long  delay  in  obtaining  new  or 
replacement  equipment.  This  delay  results  in  equipment  being  kept  long 
beyond  its  useful  life.  The  determination  of  useful  life  should  be 
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based  on  the  cost  of  performing  work  with  the  equipment,  not  on  the 
age  of  the  equipment.  The  IBM  7090/94  and  IBM  7080  computers  were 
designed  more  than  10  years  ago,  yet  these  computers  are  cost  effective 
today  if  they  are  owned. 

The  other  major  effect  of  the  present  procedures  is  the  installa¬ 
tion  of  several  small  and  medium  scale  computers  in  the  same 
geographical  area.  There  are  several  locations  which  have  over  50 
computers.  These  multiple  computers  can  result  in  costs  which  are  as 
much  as  5  times  larger  than  would  be  necessary  if  a  few  large  computers 
were  used  in  a  shared  operating  mode. 

Additional  views  on  the  Government's  selection  and  procurement  of 
computer  systems  are  summarized  in  the  Annex.  The  text  of  this  short 
report  delineates  many  of  the  ADP  problems  which  currently  face  the 
Department  of  Defense  and  for  which  answers  are  urgently  required. 

4.0  COMPUTER  SYSTEM  CHARACTERISTICS 

Computer  equipment  has  varied  characteristics  depending  on  the 
manufacturer  and  the  intended  use  and  market  for  the  equipment.  In 
general,  computer  systems  are  designed  for  families  of  applications 
and  the  major  division  is  between  Scientific  Computing  and  Business 
Data  Processing.  Developments  in  ADP  equipment  have  gone  in  all 
directions  and  ADP  equipment  is  available  in  all  sizes,  prices,  and 
capabilities.  The  "Auerbach  Standard  ADP  Reports"  is  a  commonly  used 
handbook  of  computer  system  characteristics  and  consists  of  ten  volumes, 
each  being  three  inches  thick.  Evaluation  of  ADP  equipment  capability 
and  selection  of  equipment  which  best  meets  a  particular  set  of  require¬ 
ments  is  a  difficult  task  requiring  large  amounts  of  technical  data  and 
experience. 
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b. 1  Current  Computer  Characteristics 

Some  of  the  characteristics  of  computer  equipment  have  heen 
summarized  (Figure  11 )  in  an  effort  to  display  the  total  costs  of 
performing  one  of  three  generalized  computer  applications.  These 
applications  include  sorting  10,000  records,  posting  10,000  trans¬ 
actions  to  a  master  file  on  tape,  and  posting  10,000  transactions  to 
a  master  file  on  disc. 

The  job  cost  of  performing  these  standard  applications  is 
determined  by  the  following  procedure: 

1.  The  monthly  lease  cost  is  divided  by  40,000  (the  approximate 
number  of  minutes  in  a  month)  giving  the  cost  per  minute  of 
the  computer  and  maintenance. 

2.  The  time  to  perform  the  application  is  multiplied  by  the 
cost  per  minute  determined  in  step  1. 

3-  The  cost  for  personnel,  supplies,  space,  power,  air  conditioning, 
and  physical  security  is  based  on  the  size  of  the  computer  system 
as  follows : 


a.  Less  than  $10,000  per  month 

b.  $10,001  to  $20,000  per  month 

c.  $20,001  to  $30,000  per  month 

d.  $30,001  to  $50,000  per  month 

e.  $50,001  to  $99,000  per  month 


20?!  per  minute 


25?!  per  minute 


30^  per  minute 


35?!  per  minute 
b0(ft  per  minute 


As  can  he  seen  from  Figure  11,  the  cost  of  performing  any  of  these 
jobs  decreases  with  the  cost  of  the  equipment  and  with  the  year  of 
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Figure  11  -  Typical  Job  Costs  on  Different 

Computer  Systems 
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Figure  ll(Cont'd)-  Typical  Job  Costs  on  Different 

Computer  Systems 
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Control  Data  Corp. 

3600  VIB  $40,110  $1.00 


VTIIB 

57,045 

1.43 

6400  VTIIA 

54,540 

1.36 

IBM  36O  20 

I 

II 

2,776 

3,558 

6. 9^ 
8-9 

IIIR 

3,630 

9-1 

IBM  360  30 

II 

4,714 

11.8 

III 

6,956 

17.4 

IIIR 

6,111 

15.3 

IBM  36O  40 

III 

8,208 

20.5 

IIIR 

7,343 

18.4 

IBM  360  50 

VIIB 

19,720 

49.4 

IBM  36O  65 

VIIIB 

51,944 

$1.30 

IBM  1401 

II 

5,920 

l4.8?i 

IBM  1410 

IV 

19,060 

47.7 

1.2 

1 

$  1.20 

$  .42 

$  1.62 

1.4 

3 

i.4o 

•  49 

1.89 

1.0 

l 

1.43 

.4o 

1.83 

1.0 

l 

1.36 

.4o 

1.76 

1.3 

3 

1.77 

•  52 

2.29 

67 

1 

4.62 

13-40 

18.02 

21 

1 

1.87 

4.20 

6.07 

61 

3 

5.43 

12.20 

17.63 

32 

2 

2.91 

6.4o 

9.31 

10 

3 

•  91 

2.00 

2.91 

20 

1 

2.36 

4.00 

6.36 

4o 

3 

4.72 

8.00 

12.72 

20 

1 

3.^8 

4.00 

7-48 

9-7 

3 

1.69 

1.94 

3.63 

25 

2 

3.83 

5.00 

8.83 

9.2 

3 

l.4l 

1.84 

3.25 

20 

l 

4.10 

4.00 

8.10 

9-7 

3 

1.99 

1.94 

3-93 

25 

2 

4.60 

5.00 

9.60 

4 

3 

•  74 

.80 

1.54 

2.0 

1 

•  99 

.60 

1.59 

2-3 

3 

1.14 

.69 

1.83 

1.1 

1 

1.43 

.44 

1.87 

1.8 

3 

2.34 

.72 

3.06 

4o 

1 

5.92 

8.00 

13.92 

15 

3 

2.22 

3-00 

5.22 

20 

1 

9.54 

6.00 

15.54 

6.0 

3 

2.86 

1.80 

4.66 

32 


Figure  11  (Cont'd)  -  Typical  Job  Costs  on  Different 

Computer  Systems 
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introduction,  and  sometimes  this  reduction  is  by  factors  approaching 
ten.  As  can  be  seen  in  Figure  11,  step  one  can  be  performed  at  a  total 
cost  of  less  than  $2.00  by  any  of  eight  computer  systems.  The  cost  of 
personnel  alone  to  do  the  same  job  on  2k  of  the  configurations  exceeds 
$2.00.  This  comparison  indicates  that  the  use  of  a  small  or  obsolete 
computer,  even  if  it  is  owned  and  no  cost  of  ownership  is  assumed,  may 
be  higher  than  the  rental  of  new  equipment  to  perform  the  same  job. 

The  Department  of  Defense  has  older  and  even  less  efficient  computers 
than  those  shown  in  Figure  11. 

With  few  exceptions,  the  greatest  gain  by  a  computer  manufacturer 
can  be  obtained  by  keeping  its  customers  dependent  on  its  equipment  to 
fill  the  customer’s  computer  requirements.  Early  in  the  development  of 
the  computer  it  became  apparent  that  the  market  for  computers  would  grow 
at  an  explosive  rate  for  many  years  and  that  if  old  customers  could  be 
kept  from  switching  to  new  equipment  from  different  suppliers  while  new 
customers  were  added,  the  manufacturers  would  be  able  to  continue  their 
growth.  This  dependence  has  been  achieved  by  maintaining  substantial 
differences  between  the  equipment  and  software  supplied  by  each 
manufacturer.  Therefore,  it  is  very  difficult  to  change  to  new  manu¬ 
facturer’s  equipment.  Sufficient  differences  exist  between  even  COBOL 
and  FORTRAN  as  implemented  by  different  manufacturers  to  make  it 
undesirable  to  change  to  another  supplier  of  computer  equipment. 

The  cost  of  software  development  is  so  great  that  most  computer 
users  cannot  afford  to  become  independent  from  the  software  supplied  by 
the  manufacturers.  The  Department  of  Defense  is  one  of  th^  few  computer 
users  who  has  sufficient  resources  to  become  independent  of  software 
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supplied  by  the  manufacturer,  but  to  date  it  has  not  made  any  real 
effort  to  achieve  this  independence. 

^•2  ADP  System  Characteristics  1970  to  1980 

During  the  past  decade  the  use  of  computers  has  expanded  at  an 
explosive  rate,  the  philosophy  of  their  use  has  changed  greatly,  and 
the  cost  of  performing  a  task  using  computers  has  been  reduced  by  a 
factor  of  approximately  ten.  During  this  time  the  computer  has 
become  a  part  of  almost  every  facet  of  the  business  and  industrial 
lile  of  the  nation  and  its  effectiveness  in  these  functions  universally 
accepted.  The  computer  technology  during  this  decade  has  developed  to 
include  time  sharing,  remote  job  entry,  storage  allocation  and  data 
protection,  and  high  speed  digital  data  transmission. 

During  the  next  decade,  it  is  expected  that  computer  systems  will 
continue  to  change  at  the  rapid  rate  which  characterized  the  preceding 
two  decades.  Continuing  development  will  reduce  the  cost  of  electronics 
by  a  factor  approaching  ten.  Advances  will  be  made  in  the  availability 
of  vast  amounts  of  on-line"  data  storage.  Files  containing  hundreds 
of  billions  of  characters  will  be  "on-line"  by  1980.  It  is  anticipated 
that  the  largest  computer  systems  by  1980  will  have  as  much  as  one 
hundred  times  the  capacity  of  the  largest  systems  today.  The  medium 
scale  computer  which  has  been  the  backbone  of  the  Department's  computer 
system  will  disappear  during  the  next  decade. 

Such  developments  will  reduce  the  cost  of  computer  hardware  by  a 
large  factor  during  the  next  decade.  The  present  computer  system  has 
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about  equal  investments  in  hardware  and  software.  The  software  cost 
for  an  ADP  system  could  be  5  times  the  hardware  cost  by  1980.  If  some 
of  the  current  predictions  of  the  reduction  in  hardware  costs  are  true, 
then  it  is  possible  that  the  Department  could  spend  millions  of  dollars 
programming  a  computer  which  would  cost  less  than  $100. 

The  development  of  time  sharing  and  remote  job  entry  will  continue 
as  the  availability  of  communications  increases.  It  is  estimated  that 
most  processing  will  be  accomplished  in  this  mode  by  1980. 

5-0  EXPECTED  ENYIR03MENT  1970  to  1980 

It  is  likely  efficiency,  effectiveness,  and  economy  will  continue 
to  be  major  DoD  guidelines  during  the  next  decade,  and  that  the  Depart¬ 
ment  of  Defense  will  be  required  to  apply  these  guidelines  to  ADP  systems 
during  this  period.  The  allowable  response  time  of  the  Department  will 
be  reduced  in  many  cases  thereby  increasing  the  computer  requirements. 
Manpower  ceilings  will  require  more  ADP  and  more  effective  use  of  ADP 
personnel  and  ADP  equipment. 

During  this  decade,  the  Department  of  Defense  will  be  required  to 
develop  extensive  computer  systems  to  replace  the  current  obsolete 
systems.  Two  such  systems  are  currently  under  development:  the 
Worldwide  Military  Command  and  Control  System,  and  the  Air  Force 
Logistics  Command  System.  These  systems  will  require  several  large 
scale  computers  and  represent  major  advances  in  the  use  of  computers 
by  the  Department  of  Defense. 
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If  the  present  economic  restraints  continue,  each  ADP  procurement 
must  he  subject  to  careful  analysis.  Therefore,  the  Department  of  Def¬ 
ense  must  provide  the  necessary  justification  for  each  of  its  major 
procurements  and  be  prepared  to  answer  questions.  The  recent  Air  Force 
Phase  II  reversal  portends  of  the  future  for  the  Department.  Selections 
which  involve  hundreds  of  millions  of  dollars  between  a  few  large  sup¬ 
pliers  are  always  questioned. 

The  recent  move  by  manufacturers  to  separate  hardware  and  software 
support,  often  referred  to  as  "unbundling”,  will  have  major  effects  on 
ADP  acquisitions  by  the  Department  of  Defense.  Conversations  with  ADP 
suppliers  indicate  that  further  "unbundling”  will  occur,  and  by  1980 
each  part  of  an  ADP  system  will  be  obtained  separately.  Main  frames, 
memories,  tapes,  discs,  printers,  card  equipment,  terminals,  maintenance, 
software,  etc.,  will  be  purchased  separately.  Large  users  will  require 
substantial  systems  staffs  to  convert  these  individual  items  into  an 
integrated  operating  ADP  system. 

A  major  change  in  the  computer  environment  during  1970  to  1980  will 
result  from  telecommunications  between  computers  and  computer  users.  A 
recent  report*  indicates  that  by  1980  most  computers  will  be  on-line  with 
teleprocessing  capability.  At  the  present  time  almost  none  of  the  Depart¬ 
ments  computers  are  on-line  with  teleprocessing  capability,  and  the  ma¬ 
jority  of  the  Department’s  computers  cannot  be  used  in  this  mode. 

*  teleprocessing",  prepared  by  the  Office  of  Telecommunications 
Management,  Executive  Office  of  the  President,  December  1969. 
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6.0  CONCLUSIONS 


The  concepts  which  guided  the  Department  of'  Defense  during  the  last 
decade  from  a  position  of  leadership  during  the  late  fifties  to  its  pre¬ 
sent  position  of  obsolescence  cannot  be  continued  another  decade.  Most 
of  the  present  ADP  system  must  be  completely  rebuilt  during  a  period  of 
austerity.  This  rebuilding  must  occur  under  dynamic  leadership  and 
cannot  be  accomplished  by  revising  directives  and  policy  statements. 
Hundreds  of  the  decisions  which  must  be  made  must  be  based  on  hard  tech¬ 
nical  facts  and  mature  judgment  and  cannot  be  made  by  the  application  of 
a  set  of  rules. 

The  Department  of  Defense  must  develop  the  capability  to  design  its 
own  ADP  systems, develop  its  own  software,  and  fabricate  its  ADP  systems 
using  the  system  elements  it  finds  in  the  marketplace.  It  must  provide 
a  career  ladder  and  salaries  which  will  attract  top  level  ADP  personnel 
into  Government  jobs.  This  is  not  an  impossible  task,  but  it  cannot  be 
achieved  without  some  major  changes  within  the  Department.  In  summary, 
the  most  critical  problems  which  the  Department  of  Defense  faces  are: 

1.  The  justification  and  selection  procedures  are  too  long  and 
expensive  and  they  often  do  not  result  in  the  most  economical 
solution  to  ADP  requirements.  Millions  of  dollars  and  several 
years  are  necessary  to  obtain  a  medium  scale  computer  system. 

By  the  time  a  computer  system  is  installed  it  is  often  inad¬ 
equate  to  perform  the  necessary  data  processing. 

2.  Most  of  the  Department's  computer  equipment  is  either  obsolete, 
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falls  into  the  small  or  medium  scale  classification,  or  is  not 
fully  used.  These  computers  perform  much  less  work  per  unit  of 
cost  and  therefore  result  in  at  least  $500  millions  of  added 
cost. 

3.  The  Department  of  Defense  derives  less  than  effective  utili¬ 
zation  of  ADP  management  personnel  because  such  personnel  are 
fragmented  throughout  the  Military  Departments  and  other  DoD 
components,  performing  essentially  the  same  tasks  in  their 
respective  organizations. 

4.  The  Department  is  currently  incapable  of  performing  its  nec¬ 
essary  role  of  system  design  under  the  environment  which  will 
result  from  "unbundling" . 

5.  The  Department  is  not  equipped  to  take  advantage  of  the  economies 
of  large  scale  computers  by  sharing  their  use  between  activities 
belonging  to  different  DoD  components. 

6.  The  Department  derives  much  less  benefit  from  its  computer  dollar 
than  industrial  users  of  ADP  equipment.  The  Department  has  no 
integrated  management  information  system  and  its  computer  files 
are  independent  and  not  capable  of  being  interconnected.  The 
Department  often  develops  similar  and  parallel  systems  for  the 
same  functions  in  each  of  the  Military  Departments.  This  du¬ 
plication  costs  the  Department  millions  of  dollars  annually. 

7-  No  office  currently  has  the  responsibility  to  determine  the 
most  cost-effective  method  of  providing  ADP  support  to  the  De¬ 
partment  of  Defense  or  has  the  authority  to  implement  such  a 
system  once  having  determined  it. 
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T .  0  RECOMMENDATIONS 


The  ADP  study  group  believes  that  the  following  recommendations  are 
necessary  to  provide  the  Department  of  Defense  with  the  capability  to 
meet  its  present  and  future  ADP  requirements  effectively  and  efficiently. 
Although  these  changes  represent  drastic  steps ,  it  is  the  firm  conviction 
of  the  ADP  study  group  that  less  drastic  changes  will  not  provide  the 
desired  results. 

The  recommendations  are: 

1.  Establish  at  the  Assistant  Secretary  of  Defense  level  an  office 
of  Computer  Systems  and  Services. 

2.  Make  this  office  responsible  for  providing  all  ADP  support  to 
the  Military  Departments  and  other  DoD  components  by  the  use  of 
a  network  of  computers  and  telecommunciations,  and  locally  in¬ 
stalled  equipment. 

3*  Assign  to  this  office  all  the  general  purpose  ADP  equipment 
currently  installed  within  the  Military  Departments  and  other 
DoD  components. 

4.  Assign  to  this  office  the  responsibility  for  coordinating  appli¬ 
cations  effort,  supplying  technical  support  to  DoD  components, 
and  establishing  appropriate  policies  and  common  data  formats 

to  this  end. 

5.  Assign  to  this  office  the  responsibility  of  DoDT s  interface  with 
the  Bureau  of  the  Budget  (now  the  Office  of  Management  and  Budget) 
the  General  Services  Administration,  the  General  Accounting  Office 
and  the  National  Bureau  of  Standards  concerning  ADP. 

6.  Establish  an  ADP  Industrial  Fund  for  the  purpose  of  purchasing  and 
leasing  ADP  equipment,  system  software,  related  telecommunications 


and  ADP  equipment  maintenance. 
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7.1  DISCUSSION  OF  RECOMMENDATIONS 


Early  in  the  data-gathering  phase  of  the  study,  it  became  apparent 
that  most  of  the  problem  areas  of  ADP  employment  were  associated  direct¬ 
ly  or  indirectly  with  organizational  complexity.  This  was  not  an  en¬ 
tirely  unexpected  result.  Certainly  the  DoD  is  one  of  the  more  complex 
organizations  with  more  than  its  share  of  real  and  artificial  barriers 
to  simple  solutions  to  problems.  The  background  information  in  the  pre¬ 
ceding  sections  brings  out  some  salient  points  in  this  regard  as  they 
apply  to  ADP. 

The  recommendations  set  forth  here,  therefore,  are  primarily  con¬ 
cerned  with  an  organizational  realignment  of  ADP  effort,  supported  by 
a  change  in  financial  structuring  and  some  streamlinig  of  justification 
and  acquisition  procedures. 

7*1.1  The  establishment  of  the  office  of  Computer  Systems  and  Service 
at  the  Assistant  Secretary  of  Defense  level  is  necessary  before  significant 
progress  can  be  made.  This  step  will  provide  the  office  with  sufficient 
stature  and  authority  to  get  the  rebuilding  job  done  internally,  and 
will  give  short  effective  communication  lines  with  other  government  ele¬ 
ments  (BOB,  GSA,  NBS,  etc.).  Currently,  the  ADP  responsibility  is  divided 
among  the  Office  of  the  Assistant  Secretary  of  Defense  (Comptroller),  the 
Military  Departments,  and  the  other  DoD  components.  This  division  of  re¬ 
sponsibility  causes  many  of  the  present  problems. 

Though  previous  studies  have  not  recommended  centralization  at  this 
level,  there  are  precedents  for  establishing  such  a  DoD  system.  Currently 
the  Defense  Supply  Agency,  the  Defense  Intelligence  Agency,  the  Defense 
Atomic  Support  Agency  and  the  Defense  Communications  Agency  provide  DoD- 
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Although  the  Department  spends  only  about  $2  billion  for  ADP  support, 
the  computer  is  a  part  of  almost  all  the  management  functions  within  the 
Department.  Additional  billions  are  spent  in  providing  data  for  computer 
processing  and  in  evaluating  the  results  of  this  data.  Decisions  involv¬ 
ing  operations  of  this  magnitude  cannot  be  assigned  to  one  of  the  Military 
Departments  but  must  be  assigned  to  the  Office  of  the  Secretary  of  Defense 
(OSD). 

7.1.2 

There  is  much  evidence  of  poorly  applied,  fragmented,  underutilized, 
and  obsolete  computer  equipment  in  DoD.  Installations  of  several  of  the 
Military  Departments  tend  to  be  clustered  together  in  geographic  areas , 
but  have  very  little  effective  consolidation  of  ADP  facilities  or  of  ap¬ 
plication  programs* 

Modem  software  and  hardware  conf igurations  with  powerful  equipment 
and  operating  systems,  and  using  versatile  communications  links,  have 
proven  their  ability  to  satisfy  the  needs  of  quite  varied  mixes  of  ap¬ 
plication  requirements.  They  are  able  to  do  this  at  significant  savings 
and  with  more  capability  than  in  fragmented  situations. 

As  long  as  each  component  or  even  sub-component  goes  its  own  way  in 
ADP,  not  much  can  be  done  to  correct  the  inefficiencies  of  fragmented  load. 
By  designating  one  organization  to  supply  ADP  support,  one  factor  present¬ 
ly  inhibiting  the  use  of  progressive  ADP  techniques  will  be  considerably 
improved.  Also,  the  use  of  common  facilities,  or  at  least  a  common  se¬ 
lection  function,  will  provide  the  best  environment  for  progress  toward 
the  much  more  subtle  and  difficult  objective  of  reducing  duplicate  ap¬ 
plication  effort.  Experience  has  shown  that  inroads  here  are  won  slowly 
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and  with  hard  work.  Too  many  people  must  learn  new  ways  and  too  many 
technical  problems  must  be  solved  along  the  way  to  permit  giant  steps. 
However,  even  small  steps  will  be  slow  in  coming  if  the  basic  hardware 
and  the  sources  of  primary  technical  support  remain  fragmented. 

The  operation  of  this  ADP  support  system  is  best  understood  if  it 
is  compared  to  the  operation  of  a  public  utility  such  as  electric  power. 
The  larger  and  newer  electric  power  generating  plants  tend  to  be  more 
efficient.  This  efficiency  has  resulted  in  concentration  of  all  gen¬ 
erating  capacity  into  a  minimum  number  of  installations.  Since  excess 
plant  capacity  is  expensive  to  maintain,  the  different  electric  power 
systems  are  interconnected  to  allow  exchange  of  power  to  meet  local  peak 
loads.  ADP  support  requirements  of  the  different  installations  within 
the  Department  of  Defense  could  be  met  much  in  the  same  manner  as  are 
electric  power  requirements  at  these  same  installations.  Commercial 
computer  utilities  are  already  coming  into  being.  Also,  a  government 
computer  utility  is  being  initiated  by  the  General  Services  Administration. 
These  changes  foretell  of  the  disappearance  of  the  medium  scale  computer 
and  will  necessitate  the  use  of  very  large  computer  systems  by  1980. 

7.1-3 

As  a  practical  means  of  establishing  the  single  source  of  supply 
for  ADP  and  of  initiating  an  orderly  replacement  of  facilities,  it  is 
necessary  to  assign  all  the  present  equipment  to  the  ADP  support  office. 

As  the  new  ADP  system  is  implemented,  it  will  be  desirable  to  convert 
some  of  the  present  equipment  into  terminal  equipment  and  to  integrate 
it  into  the  overall  system.  These  goals  are  best  obtained  if  the  equip- 


ment  is  assigned  to  the  new  organization.  After  the  equipment  ownership 
has  been  reassigned,  it  will  continue  to  be  used  in  the  present  mode 
until  more  efficient  support  can  be  provided  to  its  present  owner. 

It  is  also  very  desirable  to  establish  the  structure  for  collecting 
meaningful  costs  as  early  as  possible  to  guide  the  development  of  the 
service  organization.  The  capital  and  lease  costs  and  the  operating  costs 
of  the  equipment  are  major  components  of  the  total. 

7.1.4 

If  the  Department  of  Defense  is  ever  to  take  advantage  of  the  capa¬ 
bility  of  ADP  equipment  and  systems,  it  must  be  able  to  use  ADP  to  in¬ 
tegrate  information  from  all  its  components  into  summary  reports  which 
can  support  its  decision-makers.  These  reports  require  common  data 
elements,  common  data  codes,  common  management  information  specifications, 
etc.  If  the  Department  is  to  have  the  capability  to  use  ADP  capacity  to 
perform  these  management  tasks  then  it  needs  a  major  standardization  effort. 
Standardization  will  also  reduce  the  present  duplication  of  effort  in  the 
preparation  of  ADP  software.  Often  there  are  three  or  more  different 
programs  which  perform  almost  the  same  function  in  each  of  the  Military 
Departments . 

An  important  communications  function  between  the  users  of  the  central¬ 
ized  service  and  the  service  itself  must  be  included.  There  will  be  a 
concentration  of  the  technology  of  the  system  in  the  central  organization 
which  must  be  transmitted  to  the  users  through  training  and  applications 
consulting.  In  the  other  direction,  the  information  required  for  load 
projection  and  desired  system  capabilities  must  flow  from  the  user  to  the 
design  and  operations  components. 
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7.1.5 

The  DoD  interface  with  the  Bureau  of  the  Budget  (now  the  Office  of 
Management  and  Budget  (OMB)),  the  General  Services  Administration,  the 
National  Bureau  of  Standards,  and  the  General  Accounting  Office  is 
currently  maintained  at  OSD  level,  in  each  of  the  Military  Departments, 
and  in  other  DoD  components.  These  duplicate  interfaces  require  more 
time  not  only  on  the  part  of  personnel  of  the  Department  of  Defense, 
but  also  on  the  part  of  personnel  of  these  outside  agencies.  The  Depart¬ 
ment  of  Defense  cannot  afford  to  waste  its  scarce  ADP  talent  with  such 
duplication. 

7.1.6 

The  industrial  fund  appears  to  be  an  appropriate  mechanism  to  shorten 
reaction  time  on  ADP  procurement  and  to  provide  a  very  good  fiscal  manage¬ 
ment  tool.  The  first  problem  which  became  apparent  was  the  long  delay 
between  conception  and  implementation  of  a  project.  Most  of  the  unnecessary 
time  losses  appeared  to  be  associated  with  the  hardware  justification  and 
acquisition  rather  than  with  the  application  request  approval,  though 
the  total  cycle  delay  often  abrogated  the  early  work  done  on  the 
specifications.  By  using  the  industrial  fund,  the  director  could  purchase 
or  lease  equipment  or  services  without  the  necessity  of  waiting  for  the 
budget  cycle. 

The  cost  of  ADP  service  could  be  collected  from  the  users  so  that 
the  cost  of  invested  capital,  depreciation  allowances,  system  designs, 
and  evaluations  could  be  recovered  during  the  life  of  the  system.  A 
direct  comparison  of  operating  cost  could  be  made  with  other  alternatives, 
principally  commercial  service,  on  a  logically  similar  basis.  If  another 
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alternative  showed  lower  cost,  then  that  alternative  could  he  used, 
or  management  action  could  he  taken  to  bring  internal  costs  in  line. 

The  concept  of  charging  users  for  services  rendered  allows  a 
straight-forward  means  for  control  of  expenditures  at  the  application 
level.  The  initial  justification  can  he  done  without  reference  to  the 
hardware,  taking  one  large  segment  of  time  out  of  the  conception-to- 
implementation  cycle]  and  then  normal  budgeting  procedures  will  maintain 
firm  management  control  over  the  life  cycle  of  the  application. 

It  should  he  recognized  that  while  the  operation  within  the  fund 
should  break  even  over  the  long  run,  it  should  he  permitted  to  show  a 
variance  in  any  single  year.  Artificial  fluctuations  of  rates  produced 
by  large  acquisitions  should  he  avoided.  Some  degree  of  stability  in  this 
respect  is  necessary  if  the  cost  of  applications  is  to  he  properly  assessed. 

The  industrial  fund  concept  has  been  used  for  other  types  of  services, 
such  as  those  provided  by  the  Military  Airlift  Command  (MAC)  and  by  the 
Defense  Communications  Agency.  Analysis  of  the  use  of  this  fund  by  MAC 
indicates  that  the  allocation  of  airlift  services  is  achieved  by  means  of 
charges  to  the  users.  The  use  of  an  industrial  fund  for  ADP,  and  user 
chargers,  would  similarly  serve  to  allocate  computer  resources.  It  is 
anticipated  that  charges  for  the  use  of  ADP  resources  would  be  established 
so  as  to  provide  a  priority  system  which  allows  urgent  work  to  be  com¬ 
pleted  when  needed  and  provide  "off -hours"  loading  for  non-urgent  work. 

7-2  Organizational  Functions  and  Responsibilities 

The  proposed  organizational  structure,  with  major  elements  identified, 
is  shown  in  Figure  12.  Brief  statements  of  responsibility  in  the  following 
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Figure  12  -  Recommended  Drganization 


paragraphs  establish  the  scope  if  not  a  detailed  description 
of  the  intended  functions. 

7*2.1  Computer  Systems  and  Services 

The  proposed  organization  would  be  responsible  to  the  Secretary  of 
Defense  for  supporting  the  entire  Department  of  Defense  in  all  aspects 
of  ADP.  It  would  manage  the  Computer  Service  Network  and  its  associated 
industrial  fund,  coordinate  with  other  government  agencies,  and  furnish 
coordination  and  support  in  applications  efforts.  The  following 
paragraphs  describe  its  subordinate  functions. 

7*2.2  Standards 

•  Establishes  and  monitors  DoD  standards  for 

•  Hardware  interfaces 

•  System  software 

•  Data  elements  and  codes 

•  Common  data  formats 

•  Data  storage  formats 

•  Provides  DoD  interface  on  ADP  standards  with  the  National  Bureau  of 
Standards  and  other  governmental  agencies. 

7*2.3*  Operations  and  User  Support 

.  Manages  the  Computer  Service  Network 

•  Provides  focal  point  for  ADP  coordination  among  the  Military  Depart¬ 
ments  and  other  DoD  components. 

•  Provides  focal  point  for  communication  between  Computer  Systems 
and  Services  and  DoD  Components 
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•  Provides  technical  assistance  to  users 


•  In  program  preparation 

•  With  information  on  available  programs 

•  On  cost  and  facilities  of  the  Computer  Service  Network 

•  In  preparing  application  justification 

•  In  training 

7* *2.4  Economic  Evaluation 

•  Assists  Computer  Systems  and  Services  office  in  making  decisions 
involving  resources 

•  Makes  economic  analyses  to  evaluate 

•  Cost  of  computer  support  to  users 

•  Lease -purchase  trade-offs 

•  Suppliers  bids 

•  Proposed  system  changes 

•  Operational  guidelines 

•  Maintains  close  interface  with  Bureau  of  the  Budget  (now  OMB), 
General  Services  Administration,  and  General  Accounting  Office 

7.2.5  Administrative  Support 

•  Provides  administrative  functions  of  Computer  Systems  and  Service 
office  for 

•  Personnel 

•  Billing 

•  Purchasing 

•  Accounting 

•  Others  as  needed 
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7-2.6  Systems  Evaluation  and  Design 


•  Serves  as  designer  and  systems  integrator  for  Computer  Service 
Network 

•  Supplies  technical  assistance  to  support  efforts  of  Operations  and 
User  Support 

•  Establishes  techniques  and  maintains  tools  for  system  evaluation 

•  Executes  additional  functions  as  described  for  its  subordinate 
elements 

7-2. 6.1  Hardware  Evaluation  and  Systems  Design 

•  Designs  computer  and  communication  configuration 

•  Evaluates  supplier  hardware  configuration  proposals 

•  Establishes  techniques  and  evaluates  available  vendor  hardware 

•  Determines  compatibility  of  components  for  mixed  system  design 

•  Evaluates  present  computer  inventory  for  capability  and/or  obsoles¬ 
cence 

7-2. 6.2  Software  Evaluation  and  Systems  Design 

•  Evaluates  vendor  supplied  software 

•  Specifies  new  software  products  for  development 

•  Assists  in  specification  and  development  of  system  software  for 
Computer  Service  Network 

•  Assists  in  development  of  "liberation"  software  to  allow  retirement 
of  obsolete  equipment 

•  Establishes  techniques  and  maintains  tools  for  evaluating  total 
systems  throughout 
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7*2.6. 3  Research  and  Development 

•  Develops  new  hardware  and  software  required  for  efficient  Computer 
Service  Network 

•  Provides  technical  direction  of  commercial  contractors  for  new 
development 

•  Takes  over  present  DDR&E  development  contracts  associated  with 
general  purpose  ADP  equipment  and  software 

7« 3  Operation  of  the  Computer  Service  Network 

The  Computer  Service  Network  will  consist  of  a  number  of  major 
computer  centers.  These  centers  will  be  connected  by  telecommunications 
links  with  users  in  the  same  geographical  area.  It  is  anticipated  that 
these  major  computer  centers  will  be  co-located  with  major  workload  con¬ 
centrations.  These  centers  will  be  designed  by  the  System  Evaluation  and 
Design  group  and  will  contain  the  most  cost-effective  equipment  for  the 
expected  workload.  -The  operating  personnel  will  most  likely  belong  to  the 
DoD  unit  where  the  equipment  is  installed.  The  Computer  Systems  and 
Service  office  will  contract  for  these  operating  personnel  and  will 
reimburse  the  DoD  unit  for  their  cost. 

Users  of  the  Computer  Service  Network  will  retain  the  capability  to 
write  their  own  applications  programs  which  will  use  the  network  com¬ 
puters.  The  Operations  and  User  Support  group  will  provide  assistance 
and  training  to  assist  these  users.  The  Operations  and  User  Support  Group 
will  maintain  a  library  of  programs  and  will  assist  users  in  adapting 
them  for  their  use.  If  input,  output,  files,  or  reports  standards 
exist  the  applicable  standards  will  be  supplied  to  the  user. 
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System  Software,  including  compilers,  utility  programs,  operating 
system,  translators,  'liberator1  programs,  and  accounting  programs  for 
service  charges  to  users,  will  be  supplied  by  the  Operations  and  User 
Support  Group. 

It  is  anticipated  that  the  Computer  Service  Network  centers  will 
be  operated  on  an  around-the-clock  seven-day-week  schedule  and  that  the 
charges  for  different  priorities  will  even  the  workload  over  the  week. 

Justification  for  the  application  of  ADP  to  the  operations  of  the 
Military  Departments  and  other  DoD  components  will  be  based  on  three 
levels . 

The  first  level  is  operational  necessity.  These  applications  are 
so  critical  that  the  mission  of  the  unit  cannot  be  completed  without  the 
use  of  ADP  support.  These  applications  are  always  approved. 

The  second  level  is  the  result  of  a  general  evaluation  of  the 
application  and  a  determination  that  the  use  of  ADP  for  a  function  is 
always  justified  on  a  cost-benefit  basis.  These  general  justifications 
will  be  published.  The  Military  Departments  and  other  DoD  components 
having  one  or  more  of  these  applications  would  have  automatic  approval 
to  use  ADP  support  for  these  applications. 

The  third  level  is  the  justification  of  the  application  for  the 
particular  user.  This  justification  will  be  performed  jointly  by  the 
user  organization  and  the  Operations  and  User  Support  Group.  In  deter¬ 
mining  the  cost  of  ADP  support,  the  rates  for  the  Computer  Service 
Network  will  be  used  in  conjunction  with  estimates  of  the  amount  of 
computer  time  that  will  be  required. 
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Although  it  is  anticipated  that  the  requirement  will  be  rare,  it 
is  possible  that  a  user  might  require  a  computer  installed  in  his  facility 
to  be  used  only  by  him.  The  user,  under  such  an  arrangement,  would 
request  the  installation  of  suitable  computer  equipment  to  meet  his 
workload  requirements.  The  total  cost  of  the  installation,  plus  overhead 
assessment,  would  be  billed  to  this  user  each  month,  and  the  monthly  bill 
would  contain  two  charges :  first,  the  cost  of  performing  the  workload 
using  the  Computer  Service  Network,  and  second,  a  surcharge  which  covers 
the  additional  cost  of  the  dedicated  computer  system.  In  so  far  as 
possible  these  installations  will  use  the  same  software  as  the  Network 
and  use  the  same  standards  for  data  elements,  codes,  formats,  and  storage. 
The  user  of  such  "dedicated"  equipment  would  also  be  charged  for  any 
special  software  developments,  maintenance  costs,  or  other  items. 

7 • 4  Implementation  of  the  Computer  Service  Network 

The  implementation  of  the  Computer  Service  Network  would  be  on  a 
progressive  basis  beginning  with  an  evaluation  of  the  status  of  computer 
support  in  each  geographical  area.  Those  areas  having  the  most  critical 
requirements  for  additional  computer  capacity  would  be  the  location  of  the 
first  computer  centers.  Each  of  the  regional  computer  centers  would  be 
interconnected  using  telecommunications  for  data  transmission  so  that 
workloads  can  be  balanced,  and  backup  computer  support  can  be  made 
available.  Equipment  which  is  released  as  the  result  of  the  availability 
of  Computer  Service  Network  support  would  be  used  wherever  its  capability 
can  be  effectively  integrated  into  the  system.  This  progressive 
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implementation  by  geographical  areas  would  allow  the  overall  system  to 
be  implemented  without  causing  major  disruptions.  Also  as  a  result  of 
solving  the  most  urgent  problems  first,  the  benefits  of  the  proposed 
Computer  Service  Network  would  be  more  immediate. 

The  initial  staffing  of  the  Computer  Systems  and  Service  office 
could  come  from  the  current  ADP  policy  and  support  staffs  of  the 
Department  of  Defense. 

It  is  anticipated  that  the  implementation  of  the  Computer  Service 
Network  might  require  three  to  five  years. 

7*5  Benefits 

It  is  expected  that  a  number  of  benefits  would  accrue  to  the  Depart¬ 
ment  of  Defense  as  a  result  of  the  recommended  changes; 

1.  The  Department  of  Defense  would  obtain  better  ADP  support  for 
less  cost  primarily  because  of  the  economies  of  the  larger 
computers.  These  larger  computers  can  perform  some  jobs  for 
l/lO  of  the  present  cost  of  work  performed  on  some  of  the 
Department’s  present  equipment. 

2.  The  responsibility  for  ADP  decisions  would  be  placed  in  an 
organization  having  the  technical  capability  to  make  these 
decisions . 

3*  The  Department  would  be  able  to  hire  better  qualified  personnel 
for  ADP  systems  activities  because  it  would  have  a  better  career 
ladder  and  could  afford  higher  salaries. 

4.  The  response  time  for  implementing  new  ADP  applications  would  be 
greatly  reduced  since  only  a  teleprocessing  link  is  required 
to  place  the  entire  capability  of  the  Department’s  Computer 
Service  Network  at  the  disposal  of  any  user. 


5*  The  Department  would  have  fewer  types  of  computer  systems  and 
therefore  much  of  the  present  duplication  of  work  involved  in 
the  preparation  of  programs  for  many  different  computers  would 
be  eliminated. 

6.  The  use  of  an  ADP  Industrial  Fund  would  provide  visibility  as 
to  the  total  cost  of  ADP  support  to  the  Department  of  Defense, 
therefore,  allowing  decision-makers  to  make  decisions  regarding 
the  desired  level  of  ADP  support  based  on  hard  facts. 

7*  By  removing  the  procurement  of  ADP  equipment  from  the  current 
budget  and  placing  it  in  the  fund  it  would  be  possible  to 
obtain  needed  equipment  without  the  necessity  of  large 
appropriations . 

V 

8.  A  continuous  review  of  the  cost  of  ADP  support  would  allow 

decisions  to  be  made  which  will  reduce  the  cost  of  ADP  support 
to  the  Department. 
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REPORT  OF  THE 


CONFERENCE  ON  THE  SELECTION  AND  PROCUREMENT 
OF  COMPUTER  SYSTEMS  BY  THE  FEDERAL  GOVERNMENT 

Federal  Executive  Institute 
Charlottesville,  Virginia 

September  15,  16,  17,  1969 


PURPOSE  OF  THE  CONFERENCE 


The  purpose  of  the  Conference  was  to  examine  the 
impact  of  recent  developments  upon  the  Government's 
existing  policies  and  practices  concerning  the  selection, 
procurement  and  management  of  computer  systems.  These 
developments  include 

the  Comptroller  General's  report  of  June  24, 

1969,  which  states  that  significant  savings 
could  be  achieved  if  selected  components 
were  procured  from  independent  suppliers  of 
such  components  instead  of  from  the  system 
manufacturer 

—  the  Comptroller  General's  earlier  report  of 
April  3,  1968,  which  states  that  substantial 
economies  might  be  achieved  if  maintenance 
of  computers  were  performed  on  an  in-house 
basis  instead  of  by  contract 

recent  actions  by  some  system  manufacturers 
to  separate  the  prices  of  equipment,  soft¬ 
ware  and  related  services,  providing  the 
customer  with  potentially  beneficial  options 
in  the  selection  and  procurement  of  systems. 

INTRO DUCT ION 

This  Report  summarizes  the  consensus  of  the  Conference 
participants.  Their  views  resulted  from  discussions  which 
followed  a  series  of  presentations  that  examined  the  impact 
of  the  recent  developments  from  several  different  perspec¬ 
tives.  Bectiuse  of  the  short  Conference  period,  the  Report 
does  not  necessarily  represent  an  exhaustive  examination 
of  the  topics  discussed,  but  it  does  provide  views  and 
suggestions  that  will  be  considered  by  the  responsible 
Federal  agencies  as  they  develop  their  respective  programs. 
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ANNEX 


CONFERENCE  VIEWS 


1.  It  appears  that  separate  pricing  of  the  various 
elements  of  a  computer  system  (i.e.,  hardware,  software, 
maintenance  and  training)  may  ultimately  work  to  the  net 
benefit  of  the  Federal  Government.  Government  actions 
should,  therefore,  be  directed  toward  capitalizing  on  the 
benefits  obtainable  from  this  trend. 

—  Separate  pricing  enables  the  customer  to 
select  and  pay  for  only  those  items  within 
a  system  package  that  he  needs,  thus 
potentially  reducing  the  cost  to  those 
customers  who  do  not  require  the  full  range 
of  system  support  formerly  included  in  the 
single  price.  Separate  pricing  can  also 
stimulate  competition  by  enabling  indepen¬ 
dent  vendors  to  bid  on  selected  elements  of 
the  system  which  heretofore  were  usually 
supplied  in  toto  by  the  system  manufacturer. 

Such  increased  competition  should  lead  to 
lower  costs  and  improved  performance. 

On  the  other  hand,  the  benefits  anticipated 
by  separate  pricing,  particularly  as  they 
relate  to  multi-vendor  procurements,  are 
offset  by  a  number  of  complex  managerial  and 
technical  problems  that  are  created  and  must 
be  brought  under  control  before  the  benefits 
can  be  fully  realized.  These  problems 
include : 

a.  the  development  of  appropriate 
interface  standards  (hardware  and  software) 
to  achieve  the  necessary  compatibility 
across  products  of  a  broader  range  of 
vendors ; 


b.  the  development  and  testing  of  new 
selection  and  procurement  techniques  that 
(1)  guarantee  total  system  performance  in 
accordance  with  the  user's  needs,  (2)  pro¬ 
vide  fair  and  equal  opportunity  for  multi¬ 
vendor  competition,  and  (3)  can  be  carried 
out  within  an  acceptable  time  frame  and 
reasonable  cost; 
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c.  the  development  of  arrangements 
and  diagnostic  techniques  for  pinpointing 
individual  vendor  responsibilities  in  the 
event  of  a  system  breakdown,  and  securing 
prompt  and  effective  vendor  response  to 
those  responsibilities. 

2.  The  Federal  Government  should  retain  the  use  of 
the  prime  contractor  concept  for  the  acquisition  of  new 
systems  until  the  implications  of  deviating  from  this 
method  are  more  clearly  defined  and  evaluated. 


The  selection,  procurement  and  managerial 
problems  associated  with  the  acquisition 
and  operation  of  whole  systems  are  con¬ 
siderably  more  complex  than  the  mere 
replacement  of  leased  peripheral  components 
within  existing  systems.  The  problems  • 
center  primarily  on  the  capability  to 
(a)  assemble  and  integrate  the  various 
elements  of  a  system  (hardware,  software, 
maintenance)  into  a  workable  whole  at 
minimal  cost  under  conditions  where  each 
element  (or  parts  thereof)  can  potentially 
be  supplied  by  a  number  of  different  vendors 
with  different  product  capabilities,  and 
thereafter  (b)  maintain  operational  effec¬ 
tiveness  when  total  system  performance  is 
dependent  upon  the  responsiveness  of  the 
several  vendors  whose  products  make  up  the 
system. 


The  prime  contractor  concept  currently  used 
by  the  Federal  Government,  coupled  with  the 
benchmark  technique,  is  a  tested,  proven  and 
effective  method  for  evaluating  total  system 
performance  against  specific  Government 
requirements.  The  method  assures  that  all 
elements  of  the  system  (e.g.,  central 
processor,  peripheral  units,  and  software) 
interact  properly  and  effectively  in  carry¬ 
ing  out  the  stated  work,  and  it  clearly  holds 
the  prime  contractor  responsible  for  any 
system  deficiencies.  It  was  noted  that  the 
benchmark  technique  itself  was  developed  to 
counteract  the  severe  operational  problems 
encountered  several  years  ago  when  system 
manufacturers  delivered  hardware  and  software 
which  did  not  work  effectively  when  combined 
into  a  single  system.  Therefore,  any  new 
techniques  developed  to  take  advantage  of 
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multi-vendor  procurements  should  be  thoroughly 
tested  before  they  are  substituted  for  exist¬ 
ing  methods. 

The  non-Government  participants  who  presented 
systems,  software  and  peripheral  viewpoints 
agreed  that  a  "systems  integrator"  type  of 
skill  is  essential  to  assure  that  all  elements 
of  a  computer  system  are  properly  integrated 
and  responsive  to  the  user's  needs.  It  was 
noted  that  the  systems  integrator  need  not 
be  the  system  manufacturer,  as  is  now  usually 
the  case.  It  might  be  an  independent  soft¬ 
ware  house,  a  "systems  integration"  firm, 
or  it  might  be  the  Government  itself.  It 
was  also  noted  that  the  function  requires  a 
high  degree  of  managerial  and  technical 
competence,  particularly  when  a  variety  of 
vendors  products  comprise  the  system.  Within 
the  Government,  it  appears  that  a  review 
should  be  made  of  whether  the  requisite  back¬ 
ground  and  technical  competence  are  available 
or  can  be  provided  to  assume  this  kind  of 
function  satisfactorily. 

It  was  noted  that  the  differences  in  degree 
to  which  system  manufacturers  have  separated 
prices  (ranging  from  no  separation  to  rather 
complete  separation)  will  pose  some  difficul¬ 
ties  in  making  comparative  evaluations  of 
their  system  proposals  and  related  costs. 

For  example,  a  Fortran  compiler  specifically 
required  by  a  user  may  be  separately  priced 
in  one  proposal,  but  may  in  another  proposal 
be  combined  without  separate  price  identifi¬ 
cation  . 

3.  Intensive  work  should  begin  now  to  develop  appro¬ 
priate  interface  standards,  looking  toward  their  full 
implementation  in  the  next  generation  of  equipment. 

The  need  for  interface  standards  becomes 
critical  when  considering  the  potentials 
of  multi-vendor  procurement.  Industry¬ 
wide  adoption  of  these  standards  will 
offer  the  user  a  wider  range  of  competitive  . 
products  from  which  to  select  the  components 
of  his  system  and  will  facilitate  its  subse¬ 
quent  managen\ent  and  operation. 
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—  The  difficulties  and  impracticality  of 

developing  interface  standards  for  imple¬ 
mentation  on  currently  available  computer 
systems  are  recognized.  Therefore,  the 
development  work  should  be  geared  toward 
imp lement at ion  or  the  standards  on  systems 
of  the  next  generation  which  are  acquired 
and  paid  for  from  Federal  funds.  Because 
of  the  lead  time  required  for  the  develop¬ 
ment  of  such  interface  standards  and  their 
implementation  on  the  vendors'  products, 
intensive  work  should  begin  now, 

—  To  achieve  this  standards  objective,  the 
Government  should  continue  actively  to 
support  and  participate  in  the  work  of  the 
American  National  Standards  Institute  (ANSI, 
formerly  United  States  of  America  Standards 
Institute,  USASI)  X3  Committee  on  Computers 
and  Information  Processing.  To  accelerate 
the  work,  however,  the  National  Bureau  of 
Standards  should  consider  embarking  on  a 
well-publicized,  fully  staffed  and  fully 
funded  effort  to  develop  standard  interface 
specifications  that  would  satisfy  the  Federal 
Government's  requirements  and  which  could  be 
introduced  into  the  X3  deliberations  for 
consideration  as  American  National  Standards. 

In  the  event  ANSI  procedures,  which  have  been 
relatively  slow  in  the  past,  fail  to  show 
promise  of  achieving  interface  standards  for 
the  next  generation  of  systems,  the  Federal 
Government  would  be  in  a  position  to  include 
these  specifications  in  the  procurement  of 
all  such  systems. 

Leased^  peripheral  equipment  components  in  systems 
now  installed  should  be  replaced  by  components  available 
from  independent  peripheral  manufacturers  or  other  sources, 
if  it  is  determined  that  such  components  are  comparable, 
compatible,  reliable,  less  expensive,  and  can  be  adequately 
maintained.  Similar  consideration  should  be  given  when 
adding  to  or  modifying  existing  systems.  These  determina¬ 
tions  should  be  made  on  a  case-by-case  basis  in  considera¬ 
tion  of  the  particular  circumstances  that  exist. 

Experiences  within  and  outside  Government 
have  demonstrated  that  selected  replacements 
of  leased  components  can  produce  significant 
economies  in  rental  costs  while  retaining 
comparable  (and  sometimes  better)  systefo 
performance. 


It  was  noted,  however,  that  because  IBM 
supplies  an  estimated  65-70  percent  of 
the  commercial  market,  the  great  bulk  of 
peripheral  components  offered  by  indepen¬ 
dent  manufacturers  are  made  to  be  compat¬ 
ible  on  a  plug-to-plug  basis  with  IBM 
equipment.  This  fact  severely  limits  the 
opportunities  for  effecting  such  replace¬ 
ments  within  the  Government's  inventory 
since  only  one-third  or  about  650  of  the 
Government's  leased  systems  are  supplied 
by  IBM.  To  extend  these  replacement 
opportunities  to  a  larger  segment  of  the 
Government's  inventory,  independent 
manufacturers  should  be  encouraged  to 
widen  the  range  of  their  compatibility 
with  other  computer  systems  and  support 
the  development  of  interface  standards. 

It  was  noted,  further,  that  the  initial 
outright  purchase  of  components  in 
accordance  with  current  purchase/lease 
policies  forecloses  any  possibility  of 
later  replacing  such  components  with 
comparable,  but  less  expensive  equipment. 

5.  A  catalog  should  be  developed  which  would  docu¬ 
ment,  for  the  benefit  of  all  Federal  agencies,  informa¬ 
tion  about  the  hardware  devices,  software  packages  and 
related  items  that  are  currently  available. 

--  In  view  of  the  growth  of  independent 

companies  and  the  resulting  variety  of 
hardware  and  software  products  that  are 
becoming  available,  the  agencies  would 
be  helped  tremendously  by  having  access 
to  a  catalog  which  described  (a)  the 
products  available,  (b)  the  performance 
factors  claimed  by  the  supplier  for  his 
products,  (c)  a  validation  of  actual 
performance,  and  (d)  an  evaluation  of 
the  performance  related  to  specific 
applications.  The  development  of  this 
catalog  should  be  undertaken  immediately. 

The  development  of  any  one  part  should 
not  be  inhibited  by  difficulties  encoun¬ 
tered  in  the  development  of  another  part. 


In  connection  with  the  catalog,  the  term 
"Qualified  Products  List"  was  discussed. 

GSA  pointed  out  that  a  true  "QPL"  requires 
either  a  Federal  specification  or  an 
interim  Federal  specification  and  that 
"QPL"  means  a  list  of  products  tested  and 
approved  under  qualification  tests  set 
forth  in  the  specifications.  Procurement 
can  then  only  be  made  from  the  QPL. 
Ramifications  regarding  use  of  QPL  need 
to  be  considered  before  moving  ahead  in 
this  area.  It  was  noted  that  "QPL's" 
exist  now  with  respect  to  automobile 
tires,  magnetic  tapes,  and  other  items 
in  accordance  with  current  General  Services 
Administration  Federal  Property  Management 
Regulations . 

The  discussion  pointed  to  a  need  for  quanti¬ 
tative  performance  measurements  as  an  aid 
to  agencies  in  the  selection  of  various 
elements  of  a  computer  system.  For  the 
near  term,  it  would  be  useful  to  establish 
a  Government-wide  mechanism  for  the  exchange 
of  information  among  Federal  agencies  on 
the  various  benchmarking  techniques  being 
used  in  the  selection  process,  and  possibly 
the  case  results  of  actual  benchmark  tests. 
On  a  longer  term  basis,  there  is  a  need  for 
a  strong  Government  program  to  develop 
performance  measurements.  This  program 
would  involve  extensive  research  which,  in 
turn,  would  benefit  from  the  information 
gathered  under  the  short-term  mechanism. 

It  was  noted  that  some  Federal  Supply 
Schedules  for  independent  suppliers  of 
hardware  devices  identify  other  equipment 
with  which  the  devices  are  compatible. 

This  practice  should  be  extended  to  all 
Schedules  to  assist  agencies  in  making 
decisions  on  the  selection  and  procurement 
of  system  components. 

As  an  extension  of  the  above  technique, 
system  suppliers  offering  system  components 
under  their  trade  names  but  which  are 
actually  manufactured  and  offered  for  sale 
by  an  independent  peripheral  manufacturer 
should  identify  in  their  Schedules  the 
source  of  their  supply. 
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6.  There  is  a  need  to  find  ways  for  reducing  both 
the  time  and  cost  involved  in  the  selection  and  procure¬ 
ment  process. 

—  The  time  span  from  the  issuance  of  an  RFP 
to  an  actual  award  in  28  situations  during 
FY  1969  was  11  months.  The  total  cycle 
from  the  system  study  to  actual  productive 
computer  operations  may  approach  4  years. 

The  result  is  that  the  computer  system 
being  operated  may  not  be  attuned  either 
to  the  latest  technology  or  to  the  user's 
current  needs.  Studies  are  needed  to 
find  ways  of  accelerating  and  reducing  the 
costs  involved  in  the  specification,  selec¬ 
tion,  procurement,  preparation  and  testing 
periods. 

—  Consideration  should  be  given  to  the  develop¬ 
ment  of  standard  benchmark  tests  in  common 
application  areas  against  which  proposed 
system  configurations  would  be  measured. 

The  results  would  be  cataloged  so  that  the 
tests  need  not  be  redeveloped  or  repeated 
for  each  subsequent  selection  involving 
essentially  the  same  type  of  application. 
Tolerance  ranges  could  be  established  to 
provide  for  slight  deviations  from  the 
standard  benchmark  as  dictated  by  specific- 
user  requirements. 

7.  Information  regarding  the  marketing  policies  of 
system  suppliers,  and  their  probable  impact,  if  am',  upon 
the  Government  shourd  be  distributed  to  Federal  agencj.es 
in  a  more  formal  way. 

Marketing  polj.cies  of  the  various  suppliers 
are  currently  in  a  state  of  flux.  In 
general,  Federal  agencies  rely  upon  trade 
journals,  newspapers,  magazines,  and  company 
representatives  for  their  information.  To 
assure  that _ complete  and  accurate  rnforma- 
tion  is  available  for  all  significant 
announcements,  arrangements  should  be  made 
to  receive  and  distribute  such  information 
to  Government  agencies  through  a  central 
point.  Care  must  be  exercised  to  distin¬ 
guish  that  information  which  is  applicable 
to  Federal  Supply  Schedule  contracts. 
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